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PREFACE TO THE SECOND ENGLISH EDITION 


The English edition does not differ essentially from 
the Polish one. Among the more important supplements I 
should mention § 6.5 containing elementary information 
on the notation of mathematical logic. To this supplement 
I was inclined by the experience of many years. For many 
students (not for all, perhaps) the notation of definitions 
of certain notions by means of the logical symbols makes 
it easier to understand these notions (e.g. the notions of uni- 
form continuity or uniform convergence). Besides that, 
this supplement is included in the book in such a manner 
that it can be omitted in reading the whole book. Among 
other changes introduced in the English text, I should 
mention the addition of a number of exercises and prob- 
lems; in the second English edition, many of them have 
been collected in the Supplement. I am glad also to men- 
tion the simplification of certain proofs, and finally the 
removal of mistakes which were found in the primary text. 
This has been done with cooperation of the translator 
of this book, Dr. J. Musielak. I should like to express here 
my thanks for his work and for the accomplishment of the 
translation. I express also my gratitude to Professor 
A. Schinzel, thanking him for a number of corrections. 


Warsaw, November 1968 K. Kuratowski 


PREFACE TO THE POLISH EDITION 


This book contains notes of lectures on differential 
and integral calculus, prepared for publication, which 
I have held for many years in the University of Warsaw. 

The examples at the end of each section form 
a necessary complement of the course. On the other 
hand, the parts of the text marked by a star may be 
omitted at a first reading. 

The first volume contains differential and integral 
calculus of functions of one variable. Function of two 
and more variables, partial derivatives and multiple 
integrals will be treated in the second volume. 

Among the text-books which have been especially 
useful in preparing this book, I should mention those 
by Banach, Courant, Goursat, Hardy, Kowalewski, Ma- 
zurkiewicz, Sierpinski, Borsuk (a collection of exercises). 

My best thanks are due to my colleagues, Professors 
Karol Borsuk and Wladyslaw Niklibore and Assistants 
Zygmunt Charzyński and Roman Sikorski for their 
numerous suggestions, hints and remarks in preparing 
my lecture for printing. I express my thanks also to the 
Department of Sciences of the Ministry of Education, 
the Editors of the Cooperative “Czytelnik”, the Swedish 
Relief Committee and to “Monografie Matematyczne”. 
I am very much obliged to them for their assistance 
in the publication of this book. 


K. KURATOWSKI 


Warszawa, October 1946 


CHAPTER I 


SEQUENCES AND SERIES 


§ 1. INTRODUCTION 


1.1. Various kinds of numbers 


We shall assume that the notion of a real number 
(i.e. roughly speaking, a number having a fimite or in- 
finite decimal expansion) is known from the middle- 
school course (1). We shall recall the terminology and 
some properties of real numbers. 

The numbers 1,2,3,..., are called positive integers. 
The number 0 belongs neither to the positive nor to the 
negative numbers. The fractional numbers, i. e. numbers 


of the form : , where p and q are integers and q 40, 
are called also rational numbers. For the rational numbers 
the four arithmetical operations: addition, subtraction, 
multiplication and division (except division by 0) can 


always be carried out; to the symbol p there corresponds 


no numerical value. Thus, the symbol oo, which will be 
often used, does not mean any “infinite’? number. 
Geometrically, real numbers may be imterpreted as 
points of a straight line upon which are fixed two points 
representing 0 and 1. These two points make it possible 
easily to construct all the rational points on this line, 
which is called the numerical line. For if we are given 
a rational number w, we take a segment of the length w 


C) In $§ 1.8 and 1.9 of this section, we give two rigorous methods 
of introduction of real numbers in outline: an axiomatic method 
and another one, which reduces the notion of a real number to the 
notion of a rational number. 
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on the right side of 0 (or on the left side, if w is negative). 
The end of this segment is the point corresponding to 
the number w. It is well known that not all points of 
the straight line correspond to rational numbers, e.g. the 
number y2, i.e. the length of the diagonal of a square 
with the side equal to 1 is an irrational number. 

Reasons of a geometric as well as of an algebraic 
nature suggest that we include in the notion of number 
all real numbers, i. e. irrational numbers as well as rational 
numbers. In this way the scope of algebraic operations 
increases: in the real domain, there exist also roots and 
logarithms of positive numbers. 

It should also be noted that in the real domain not 
all operations can be carried out, e.g. there do not exist 
square roots of negative numbers and, consequently, 
equations of the second degree do not need to possess 
real roots. To avoid situations of this kind, complex 
numbers are introduced. However, we shall not consider 
complex numbers just now. When we use the word 
“number” here we shall always have in mind real numbers. 


1.2. The principle of mathematical induction 


Among the properties of positive integers we shall 
mention the following one which we shall often use. 
It is called the principle of mathematical induction. The 
principle .may be stated as follows. 

Let us assume that a property of positive integers is 
given, satisfying the following conditions: 

(i) the number 1 possesses this property, 

(ii) if the number n possesses this property, then the 
number n-+1 possesses it, too. 

The principle of induction states that, under these 
assumptions, any positive integer possesses the property 
stated. 

The principle is in agreement with the following in- 
tuitive argument: if the number 1 possesses the con- 
sidered property, then the second condition implies that 
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the number 2 possesses this property; but then, again 
by the second condition, the number 3 possesses this 
property, similarly, this implies that the number 4 pos- 
sesses the property etc. Obviously, we are not able to 
perform this reasoning to infinity. The principle of in- 
duction gives a mathematical formulation to our in- 
tuitive reasoning. l 

As an example of the application of the principle of 
induction, we shall quote the proof of the so-called 
Bernoulli (1) inequality: for each positive integer n and for 
any real number a > —1, the formula 


(1) (l+a)">1+na 


holds. 
We begin by noting that the expression x > y means 
that x is greater than y or equal to y or that v is not less 
than y. Thus, 3 > 2 holds as well as 3 > 3. 

In order to prove the Bernoulli inequality by using 
the principle of induction we must show: 


(i) that the number 1 belongs to the set of numbers n 
possessing the property expressed by the inequality (1); 
this is obvious, for substituting the number 1 in place 
of n in the inequality (1) we obtain the inequality 
1+a2>1-+a which holds for every a; 


(ii) that the formula (1) implies the formula obtained 
from (1) by substitution n +1 in place of n in (1), i.e. the 
formula 
(1’) (1+ajt>1+(n+1)a. 


To prove this formula, let us multiply both sides of 
the inequality (1) by 1+ a. Since we have 1+a>0 by 
assumption, we obtain 


(1+a)"t! > (14 na)(1+a) = 1-+(241)a+na?. 


(‘) James Bernoulli, a Swiss mathematician in the first half of 
18th century. 
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However, na? > 0; hence 
1l+(n+l)at+na® >14+(n+lja, 


which yields the formula (1’). 

As a second example of the application of the principle 
of induction we shall give the proof of the following 
trigonometric relation 

1 sin ant t 
(2) z tT Cost + cos 2t +... + cosnt = ————. , 
2sin 5 


satisfied by each integer n > 0 and by any real number t 
which is not an integral multiple of the number 2x. 
In this case, we begin the induction with 0 instead of 1. 


When »=0, formula (2) is an identity = sinjt 1 


Qsinkt 2° 
Thus, it remains to prove that formula (2) implies for- 
mula (2’) obtained by substitution +1 in place of n 
in (2). 

Applying formula (2), we may write formula (2’) in 
the following form: 


sin ana t sin ant $ t 
(2) n a E = ——_, 
2sin 5 2sin5 


or (reducing to common denominator) 


ey ay oe 
2 2 


sin n t = 2sin 5 cos (n +1)t. 

But the last formula follows from the known formula 
for the difference of the sine. Hence we have proved 
that identity (2) implies (2’); thus, formula (2) holds for 
each n >0, by the principle of induction. 


1, INTRODUCTION 15 


1.3. The Newton () binomial formula 
First of all, we shall define the so-called Newton or 
binomial coefficients by the following formula: 


(1) n{n—1)(m—2)-...+(m—h#+4+1) 


(3) k L23- aak ; 


Thus it is seen that the denominator is a product of 
successive positive integers from 1 to k, and the numerator 
is a product of k successive decreasing positive integers 
from n to n—k-+1. Here we assume n and k to be positive 
integers and n > k. 


We test immediately that K =n and (") =1. We 
extend the definition of the symbol h) to the case where 


k=0 by writing (o) = 1; we adopt this convention to 
simplify the technique of calculations. 
Finally, let us note that (7) is the number of com- 


binations of n elements by k; we shall not use this fact here. 
The following formula holds (for an arbitrary positive 
integer k): 


n n n+1 
(4) G+ (2a) = Ce )- 
Indeed, 
Mo. (WTA 2) (nT RAT) , eo (Nak?) k 
1... (k—-1)k 1-..-(k-1) k 
Meet (n—k+2)(n—k+1+k) pi 
+ 1-...- (k—1)k o Nk 


In the above reasoning we applied the formula (3); 
hence we had to assume that k—i is a positive integer, 
i.e. that k > 1. However, if k = 1, the formula (4) may 
be checked directly, substituting k = 1. 


(1) Isaac Newton, 1642-1727, one of the most eminent scientists 
in history. One of the inventors of the differential and integral 
calculus. 
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Now, we shall prove the Newton binomial formula, 
i.e. the following formula: 


(5) (a+b)"= 
=a" k a” "b+ f) aB.. (o) Bee ae ( 


Min 
"se" 

It is easily seen that the right side is a sum of n+1 
components; the first one is a” and the last one b”, since 
W = 1. This formula is obvious for n = 1. For n= 2 
and n = 3 it is known from the middle-school course. 

Since the formula (5) holds for n = 1, according to 
the principle of induction, assuming (5), it remains only 
to prove that the formula obtained by substitution n -+1 
in place of n in (5) is true. But (a+ )"*' = (a+b)"(a+b) 
= (a+b)"a+(a+5)"b, whence 


(a+ by} 
= atts (Ma + (2)a" tbt + wie (partt pk I hyk (") ab” + 
+a" + (Tab + +(e jar Pek + nna (04) ab" + (port: 


= att + ("{)a% erak [i artna Aout ("iab + ntl 


where we applied formula (4).!The equation obtained 
in this way is just the equation obtained from (5) by 
substitution +1 in place of n. Thus, the Newton bi- 
nomial formula is proved. 

We should note that the Newton binomial formula 
may be written in a neater way as follows: 


n 


(6) (a+b = D (pjani 


k=0 


(when a 40 + b) (}). 


0) When a=0 or b= 0, formula (6) may be also applied 
with the restriction that the indeterminate symbol 0° (which is 
obtained for k = n or k = 0) has to be replaced by 1. 
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n 
The symbol » means that we must take the sum 
k=0 


of n+1 terms which are obtained from the expression 
beyond this symbol by substituting successively all integers 
from 0 to n in place of k, and adding the terms so 
obtained. 

Moreover, the binomial coefficients may be written 
as follows. Let us denote by n! (read: factorial n) the 
product of all successive positive integers from 1 to n: 


(7) n! =1.2.3...-n (and let 0! =1 by convention). 


It is easily seen that we have 


$ 0 -am 


1.4*. Schwarz inequality 

Applying the principle of induction, we shall prove 
the following inequality: 
(9) (Bt. +8 n Yn)” < (Gio +n) (Yit -H Ya) - 


For n = 1 the formula (9) is obvious: (2,y,)° < siyi. 
Thus, we have to prove this formula for n+1, assuming 
that it is true for n. 

Now, 


(10) (Wy Yee + Enti Yngi)? = (BY +.. + Ln Yn)? + 
+ 2 (LY +... + En Yn) Ung Yagi + tani Yaar . 
Moreover, 2ab < a? + b?, since a? + b?—2ab = (a— b? >0; 
hence, writing @ = 7% Yn4, and b = LnyYk, We have 
Qe Ye Eny Yni < Tk Ynti + ngs Yi 
and suming for k = 1, 2,...,”, we obtain 
2(81Y1 + H En Yn) ntr Ynt 
< (ti +. ADR) Ynti + (Yi + -H Yn) Dari - 
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Applying (9) and (10) we get 
(2191 + oe + Enyi Ynsi) < (ai + oe + ae) (Yt + Yn) + 
+ (21+. H La) Ung + (Yi + oe H Yn) Enyi + Enti Ynti 

= (pe Fan) (Yt ten H Yapa) + (Yt H o H Yar) Enya 
= (i +.. + any) (Yi + ah + Ynt1) . 
This yields 

(@ Ya +- + Lnr Ynn) < (EH -H a) (Yi + + Yata) 


But this is just the formula obtained from (9) by sub- 
stituting n+1 in place of n. Thus, the proof is finished. 


1.5. The principle of continuity (Dedekind (’)) 


Among the properties of real numbers, we shall mention 
the so-called continuity principle. This principle states 
that if we divide the set of all real numbers into two 
sets A and B such that any number belonging to the 
set A is less than any number belonging to the set B, 
then there are two possibilities: either there exists a great- 
est number of the set A or there exists a least number 
of the set B (it being assumed that both the sets are 
non-empty). In other words, if we divide the straight 
line in two parts A and B in such a way that any point 
of the part A lies on the left side of any point of the part B, 
then either there exists a last point in the part A or there 
exists the first point in the part B. No “gap” may be 
found in this “cut”? which we have performed. This 
implies the continuity of the set of real numbers dis- 
tinguishing this set from the set of rational numbers, 
where such gaps exist; e.g. dividing the set of rational 
numbers in two parts such that all rational numbers 
<y? belong to the first part and all other rational 
numbers, ie. numbers > y2, belong to the second part, 
it is easily seen that any number of the first part is less 


() Richard Dedekind, a German mathematician in the second 
half of the 19th century. 
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than any number of the second part, but there does not 
exist any rational number which would be the greatest 
in the first part or the least in the second one (this 
follows from the fact that the irrational number y2 
may be approximated arbitrarily accurate by the rational 
numbers from below and from above, e.g. by the decimal 
expansions). 


1.6. The absolute value of a number 


The absolute value of a number aq, i.e. jal, is defined 
by the conditions: if a >0, then la| = a; if a< 0, then 


la| = —a. The following formulae, known from elementary 
mathematics, hold: 

(11) ja = |—a| ’ 

(12) —|a|<a<jaj, 

(13) la+bi <Ja/+|ol, 

(14) (a|—|b| <ja—b] <]aj+]bl, 

(15) |ab| = |a|-|b], 


(16) the inequalities |a| <c and |b] <d imply |a+b| <e+d; 


tbe proofs will be left to the reader. 

The last formula (16) is the formula for the addition 
of inequalities ‘under the sign of absolute value” which 
we shall often apply. It follows from the formula (13), 
since |a +b] <|a|+]b| <e+d. This formula remains true, 
if the sign < is replaced by <. 

Finally, let us note that 
(17) the inequality ja|<b is equivalent to the double 

inequality —b<a<b and hence to the collection 
of two inequalities: a <b and —a < b. 


1.7. Bounded sets. The upper bound and the lower bound 
of a set 
We say that a set of real numbers Z is bounded, if 
two numbers m and M exist such that every number 2 
belonging to the set Z satisfies the double inequality 
m <2 < M. Assuming only that there exists a number M 
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satisfying the inequality M > for. every w belonging to 
the set Z, we call the set Z bounded above. Similarly, 
a set Z is called bounded below if a number m exists 
satisfying the above condition: m < z. 

The geometrical meaning of these ideas is the following. 
If a set is bounded it means that it is contained in a cer- 
tain segment on the numerical line. A set is bounded 
above or below, when it is contained in an infinite radius 
directed to the left or to the right, respectively. 

Applying the continuity principle we shall prove the 
following theorem: 


If a non-empty set Z is bounded above, then among the 
numbers M, satisfying the inequality M >x for any x 
belonging to Z, there exists a least one. This number will 
be called the upper bound of the set Z. 


Similarly, if a set Z is bounded below, then among the 
numbers m, satisfying the inequality m<a for any æ 
belonging to Z, there exists a greatest one, which is called 
the lower bound of the set Z. 


Proof. Let the set Z be bounded above. Let us divide 
the set of all real numbers in two classes as follows. 
To the second class there will belong all numbers M 
satisfying the inequality M > x for any æ belonging to Z. 
To the first class there will belong all other real numbers; 
that means that a number a belongs to the first class 
when in the set Z there exists a number greater than a. 
Such a division of the set of real numbers in two classes 
is called a cut, i.e. any number belonging to the first 
class is less than any number belonging to the second one. 
Indeed, supposing a number M of the second class to be 
less than a number a of the first class and knowing that 
a number v exists in the set Z such that a < æ we should 
have M < x; but this contradicts the definition of the 
second class. 

Moreover, let us note that both classes are non-empty. 
Indeed, if a number z belongs to the set Z (and such 
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a number exists, the set Z being non-empty by assumption), 
then the number z—1 belongs to the first class. The 
second class is also non-empty, since the set Z is bounded 
above. 

According to the continuity principle there exists 
either a greatest number in the first class or a least 
number in the second class. However, the first eventuality 
is not possible. Namely, if a belongs to the first class 
and a< x (where ~ belongs to Z), then denoting by a’ 


a+r 
any number between a and x, e.g. a’ = ase we have 


2 
also a’ < æ, but this means that a’ belongs to the first 
class, too. Thus, to any number a of the first class we 
may find a number a’ greater than a in this class. This 
means that in the first class a greatest number does not 
exist. Hence, there exists in the second class a least 
number, i.e. the least number among the numbers M 
satisfying the inequality M > <x for every «x belonging to 
the set Z. Hence the theorem is proved. 

The proof of existence of a lower bound is completely 
analogous. 

Let us note that the upper bound and the lower bound 
of a set Z do not necessarily belong to this set. E. g. the 
bounds of the open interval (+) a < x < b are the numbers 
a and b which do not belong to this interval. 


1.8*. The axiomatic treatment of real numbers 


The notion of a real number which we have assumed 
to be known from the middle-school course may be in- 
troduced in an axiomatic way as follows. 

We assume that in the set of real numbers two 
operations can be performed: addition x+y and multi- 
plication xy. These operations satisfy the laws of com- 


(‘) By an open interval we understand the set of numbers z 
such that a< x< b; by a closed interval we understand the open 
interval together with ends, i.e. the set of « such that a< g< b. 
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mutativity and associativity: 


Try=Ytr, ry = Ye, 
(v+y)+z=æ+(y +2), (ay)e = æ(yz). 


Moreover, the multiplication is distributive with respect 
to the addition: 
aly +2) = xy + aez. 
Two (different) numbers 0 and 1 are the moduli of 
addition and multiplication respectively, i.e. 


2+0=27, wl=-2. 


Further, we assume that in the set of real numbers 
subtraction and division are always possible, except 
division by 0. In other words, we assume that to any 
pair of numbers x and y a number z (called the difference 
æ— y) exists such that 


Lm y+Z 
and, in the case where y #0, a number w (called the 
quotient x: y) exists such that 

L= yw. 

Besides the above axioms concerning the operations, 
we take following axioms concerning the order relation 
x<y. We assume that any two distinct real numbers 
æ and y are in this relation in one or another direction, i.e. 
either x < y or y < x. This relation is transitive, i.e. 

the conditions x< y and y <z imply <z 
and asymmetric, i.e. 
if æ < y, then the relation y < æ does not hold. 

The order relation is connected with the basic opera- 
tions by the following axiom: 

if y<2, then xwt+y<a2+2 and if, moreover, 0 <2, 

then wy < xz. 
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Finally, the last axiom in the theory of real numbers 
which we are accepting is the Dedekind continuity principle 
formulated in § 1.5. 

All arithmetic and algebraic theorems known from 
courses in the middle-school may be deduced from the 
above axioms. 


1.9*, Real numbers as sets of rational numbers (') 


The notion of a real number may be defined on the 
basis of the theory of rational numbers as follows. 

Real numbers may be considered to be identical with 
sets of rational numbers R, satisfying the following 
conditions: 

(i) the set R does not contain a greatest number, 
i.e. for any number belonging to the set R there exists 
a greater number in R; 


(ii) if a number a belongs to R, then any rational 
number less than x belongs to R; 


(iii) the set R is non-empty and is not equal to the 
set of all rational numbers. 


For real numbers defined in this way we define first 
of all the relation of order. Namely, we write R< F’, 
when the set R is a part of the set A’ (different from R’); 
or, when the set R’ contains numbers which do not belong 
to R (it is easily seen that for any two sets satisfying 
the conditions (i)-(ili) always one is contained in the 
other). Both these definitions are equivalent. 

We easily find that the order relation defined in this 
way satisfies the axioms given in § 1.8, i.e. it is a transitive, 
asymmetric relation which holds for any pair of different 
sets R and Ff’ in one or other direction. 

Now we define the addition of real numbers, i.e. the 
addition of sets R and R’ (satisfying the conditions 


(0) We give here an outline of the so-called Dedekind theory 
of real numbers. 
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(i)-(iii)). Namely, by 2+’ we denote the set of all 
numbers which are sums of two numbers, the first of 
which belongs to R and the second one belongs to R’. 
It is easily seen that the set R+ R’ satisfies the conditions 
(i)-(iii). Moreover, the axioms concerning the addition 
(commutativity, associativity etc.) are satisfied. The real 
number 0 is defined as the set of all negative rational 
numbers. Similarly, the real number 1 is the set of all 
rational numbers less than the rational-one. In general, 
if r is a rational number, then we understand by ‘the 
real number r” the set of all rational numbers less than 
the rational number r (in practice, we identify the rational 
number r and the real number r). —R means the set of 
all rational numbers of the form — g, where v takes all 
values which do not belong to R; however,-if the set of 
numbers not belonging to R contains a least number r, 
then we do not include the number —r in the set —R 
(that is the case, when R is “the real number r”). One 
may prove that R+(—R) = 0. 

The multiplication of real numbers will be defined in 
the following way: if R >0 and R’ >0, then RRA’ is the 
set containing all negative rational numbers and numbers 
of the form rr’, where r is a non-negative number belong- 
ing to R and, similarly, r’ is a non-negative number belong- 
ing_to R’. Moreover, we assume 


(—R)(—R') = RR’, (—R)R = —(RR') = R(—R'). 


It may easily be proved that all the axioms con- 
cerning the multiplication are then satisfied. 

Finally, the continuity axiom is satisfied. Indeed, 
let A, B denote a cut in the domain of real numbers. 
We denote by R the set of rational numbers with the 
property that r belongs to R if and only if it belongs 
to one of the real numbers belonging to the class A. 

It is proved that the above defined set R satisfies 
the conditions (i)—(iii), so that-it is a real number. Then 
we prove that R “lies on the cut A, B”, i.e. that it is 
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either the greatest number in the set A or the least 
number in the set B. 

Thus, we see that, if we understand by a real number 
a set of rational numbers satisfying the conditions (i)—(iii), 
then all axioms of the theory of real numbers formulated 
in §1.8 are satisfied. 

Let us add that the set of all rational numbers satis- 
fies all these axioms with the exception of one axiom, 
namely the continuity axiom. 

Hence it follows that the continuity axiom is in- 
dependent of the other axioms of the theory of real 
numbers; for if it were a consequence of the others 
(i.e. a theorem and not an axiom), then it would be 
satisfied in every system in which the other axioms are 
satisfied. 


Exercises on § 1 


1. Prove that for each positive integer-n and for any 
real a > —1 the following formula holds (being a gener- 


alization of the Bernoulli formula (1)): 
(1+ a)" > tna +2) gy Man?) as, 


Hint: proof by the mathematical induction. 
2. Prove the identities: 


14+2+4..+n = n f 
parpat = PEDON) 


Hint: in the proof of the second equality one may 
apply the identity: 


(k +1}— k = 3k + 3k +1. 
3. Similarly: find the formula for the sum 


L2... +n. 
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4, Deduce the formulae: 
n n n n 
ot G) ++ h) =2" 
n n n. n 
(a) ~ G) + (2) Eh) = 
Hint: apply the Newton binomial formula. 
5. Applying the continuity principle prove that ya 
exists for each positive integer n and for any positive a. 
6. Prove that ja]— b|| < |a—b|. Prove that the equa- 
tion |a+b| = {a|+ {b| holds, if and only if ab > 0. 


7. Denote by A and G the arithmetic and the geometric 
mean of the numbers a, a2, ..., Qn, respectively, i.e. 


A SEO oe G = Va, Oy: ° Gy. 


Prove that if the numbers ai, az, ..., an are positive, 
then G <A. 

Hint: precede the proof by the remark that if a < A 
< a, then the arithmetic mean of the numbers A, a,+ 
+a,—A, a3, a, ..., Anis A and the geometric mean of these 
numbers is >G. 

8. Denoting by H the harmonic mean of the above 
numbers Az, a2, ..., An, i.e. writing 


1 1 1 
H=ni(-+o+..+2), 
a, ay On 


prove that H <G. 


§ 2. INFINITE SEQUENCES 


2.1. Definition and examples 


If a real number corresponds to each positive integer, 
then we say that an infinite sequence is defined. 

For instance, positive even numbers constitute an 
infinite sequence 2, 4,6,...,2n,...; namely, to the num- 
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ber 1 there corresponds the number 2, to the number 2, 
the number 4, to the number 3, the number 6, and, 
generally, to the positive integer n there corresponds 
the number 2n. 

Usually, we write an infinite sequence in the form 
Qis A, 1-5 Ang.. OF {an}. The numbers appearing in the 
sequence are called the terms of the sequence; the ex- 
pression a, is called the general term of the sequence. 
Thus, for the sequence of positive even numbers the 
general term is 2n; for the sequence of odd numbers 
the general term is 2n—1. 

In an infinite sequence some terms may be repeated. 
E.g. if the number 0 corresponds to the odd positive 
integers and the number 1 to the even positive integers, 
then the sequence 0,1, 0,1,... is obtained. This sequence 
consists of two alternating terms. 

In particular, all terms of a sequence may be identical: 
C, C, Oy aus 

As examples of sequences we shall mention the arithme- 
tic and the geometric progressions. The arithmetic pro- 
gression is a sequence of the form c,c+d,c¢+2d,..., 
i.e. a Sequence with the general term ¢+(n—1)d. Simi- 
larly, the general term of a geometric progression is 
a, = egt. 

A definition of a sequence by induction (i.e. a recur- 
rence definition) is often used. Here, we define directly 
the term a, but a, is defined by means of the earlier 
terms, e.g., write a = l, a, = 2%. The first terms of 
this sequence are: 1, 2, 4,16, 218, ... 

Finally, let us note that it may not always be possible 
to write the general term by means of a formula. For 
example the prime numbers constitute, as is well known, 
an infinite sequence but we do not know any mathemati- 
cal formula defining the »-th prime number. 

Geometrically, we interprete an infinite sequence as 
a set of points on the piane (on which the axis of abscissae 
and the axis of ordinates are given; cf. Fig. 1, p. 30). 
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Namely, the sequence a, a2, ..., Qn, -.. is the set of points 
(1, a), (2, a), ...,(, @),... For example the set of po- 
sitive integers is the intersection of the straight line 
y =x and of the pencil of straight lines parallel to the 
Y-axis passing through the positive integer points on the 
X-axis. Similarly, the sequence with a constant term c is 
the intersection of the above pencil and of the straight line 
parallel to the X-axis. If we take on the straight lines 
of this pencil points with the abscissae 0 and 1, alter- 
nately, we obtain the oscillating sequence 0,1,0,1,... 

As may by seen from the above remarks, an infinite 
sequence and the set of the terms of this sequence are 
two distinct notions: a sequence is a set of points of the 
plane and the set of terms of a sequence is a certain set 
of real numbers, i.e. from the geometrical point of view, 
a set on the straight line. Two different sequences may 
consist of the same terms: the above defined oscillating 
sequence 0,1,0,1,... and the sequence 0,1,1,1,... 
(having at the first place 0 and at all other places 1) 
have the same terms; however, they are sequences with 
fundamentally different properties. 

A sequence is called increasing, if a, < a, < ag... in 
general: if a, < än. Similarly, a sequence is called de- 
creasing, if dn > ân. If we replace the sign < by < 
(or > by >), we obtain increasing (or decreasing) se- 
quences in the wider sense, called also non-decreasing 
(or non-increasing) sequences. Increasing and decreasing 
sequences in the wider sense are generally called monotone 
sequences. 

The sequence of even numbers is an increasing se- 
quence, the sequence 1,1,2,2,3,3,... is an increasing 
sequence in the wider sense. The oscillating sequence 
0,1,0,1,... is neither increasing nor decreasing. 


2.2. The notion of limit 
A number g is called the limit of the infinite sequence 
Ais Azs 3 n,... if to any positive number €a number k 
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exists such that for n > k, the inequality 
(1) |an—g| < E, 


holds, i.e. an lies between g—e and g+e. 
We denote the limit of a sequence by the symbol 
(2) g = lim an. 
næ 
Let us take the sequence with the general term 
n+l 


n 


n = as an example of a sequence with a limit, 


i.e. the sequence 2,143, 14, ...,14,.. We shall prove 
that 1 is the limit of this sequence. 
Let a number <> 0 be given. We have to choose k 


in such way that for n > k, the inequality zila <e 


would hold, i.e. that <e. Now, let k be a positive integer 


greater than L, Then we have i< €; thus, the double 


inequality = < . <e holds for n > k, whence = <E, as 
we set out to prove. 
Let us note that we have proved simultaneously that 


The number k chosen to the given e depends on e. 
Mostly, if we diminish €, k has to increase (this fact is 
easy to observe in the above example). 

To express this more figuratively, the condition for g 
to be the limit of a sequence a,, az, ... may be formulated 
as follows: for any «> 0, the inequality (1) is satisfied 
for all sufficiently large values of n. 

A sequence having a limit is called convergent. A di- 
vergent sequence is a sequence which has no limit. As an 
example of a divergent sequence, let us take the sequence 
of all positive integers. Indeed, let us suppose that g is 
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the limit of the sequence of positive integers. Writing 1 
in place of £ we have, by (1), the inequality |n—g|<1 
for sufficiently large n; thus n<g+1. Here is a con- 
tradiction, since just the reverse inequality n > g+1 holds 
for sufficiently large n. This contradiction shows that 
our supposition that the sequence of positive integers 
has a limit was false. Thus, it is a divergent sequence. 
Similarly, one might prove that the oscillating sequence 
0,1,0,1,... is divergent. 
Further, 
(3) lime =c, 


n= 


i.e. the sequence with constant term e¢ has ¢ as the limit. 


Fie. 1 


Namely, we have always a,—c = 0. Thus, the in- 
equality (1) holds for all n. 


Geometrically, the notion of limit may be interpreted 
as follows. Let a sequence a,,a,,... be given (e.g. the 
sequence with the general term nto). Let us imagine 
the geometrical interpretation of this sequence on the 
plane according to § 2.1. Let us draw a straight line 
parallel to the X-axis through the point g of the Y-axis 
(e.g. g = 1). Moreover, let us draw two straight lines 
parallel to the last one on two different sides of it but 
in the same distant. The condition that the equality (2) 
holds means that for sufficiently large » (i. e. for n larger 
than a certain k), all terms of our sequence lie in the 
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strip determined by the two above-defined parallel 
straight lines. 

The above geometrical condition may be easily ob- 
tained from the analytical condition formulated in the 
definition of limit denoting the breadth of the above 
strip by 2e. 

In other words, the condition for the convergence of 
a sequence to g may be formulated as follows: every 
interval with the centre g contains all elements of the 
sequence beginning with a certain index. 

In the above examples we have seen that a sequence 
may have no limit (if it is divergent); the question arises 
whether if a limit exists (thus, if the sequence is con- 
vergent), then it is unique. We shall show that it is 
really the case. 

For let us assume a sequence ai, 4@,,... to have two 
different limits g and g’. Then we have |g—g’|> 0. Let 
e = $|g—g']. According to the definition of the limit, 
two numbers k and k’ exist such that for n> k the 
inequality 


(4) |an—g|<e, 
and for n> k the inequality 
(5) |Qn—g’| <e 


hold. 

Thus, denoting by m the greater among the two 
numbers k and k’, the inequalities (4) and (5) hold for 
n>m, simultaneously. Let us add both sides of these 
inequalities uncer the sign of absolute value (cf. § 1 (15)), 
after changing the sign under the absolute value in the 
formula (4). We obtain |g—g’|< 2e, but 2e = |g—g’J. 
Thus, we get a contradiction. 

Remark. It is easily seen that the notion of limit 


is not changed, if we replace in the definition of limit 
the sign > by > or < by <. 
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2.3. Bounded sequences 


A sequence a,,a,,... is called bounded if the set of 
its terms is bounded, i.e. if there exists a number M 
such that the inequality |an]< M holds for all values 
of n. In other words, the inequality —M < an< M is 
satisfied for all terms of the sequence. 

The geometrical interpretation of this condition is that 
the whole sequence (treated as a set on the plane) is 
contained between two straight lines y = M and y = — M. 

We say also that a sequence is bounded above if a num- 
ber M exists such that a, < M for all n, ie. that the 
sequence lies below the straight line y = M. The notion 
of a sequence bounded below can be defined analogously. 
Clearly, a sequence which is bounded above and below 
is simply a bounded sequence. 

EXAMPLES. The sequence 0,1,0,1,... is bounded. 
The sequence of positive integers is unbounded, though 
it is bounded below. The sequence 1, —1, 2, —2, 3, —3, ... 
is neither bounded above nor bounded below. 

THEOREM. Every convergent sequence is bounded. 

Indeed, let us assume that the equation (2) holds and 
let us substitute the value 1 for «. Hence a number k 
exists such that we have |a,—g|<1 for n>k. Since 
|anj|—|g| <jan—gl (cf. § 1 (13)), we have {a,| < |g|+1. 
Let us denote by M a number greater than any among 
the following k +1 numbers: |a,|, |a,|, ..., [axl], |g|+1. Since 
the last one is greater than |a,+1|,|a42| etc., we get 
M >|a,| for each n. Thus, the sequence is bounded. 


2.4. Operations on sequences 

THEOREM. Assuming the sequences a,, az, ... and bi, by, ... 
to be convergent, the following four formulae hold (?): 
(6) lim(an + bn) = lima, +lim), , 
(7)  lim(a,—b,) = lima,—limb,, 

(t) To simplify the symbolism we shall often omit the equality 
n = œ under the sign of lim. 
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(8)  lim(a,-6,) = iman: limb, , 
a, _ lima, 
b, limb, 

This means that under our assumptions the limit of 
the sum exists and is equal to the sum of limits, the limit 
of the difference exists and is equal to the difference of 
limits etc. 


(when limb, £ 0). 


Proof. Let us write lima, = g and lim b, = h. A num- 
ber £> 0 let be given. Hence a number k exists such 
that the inequalities |an— g| < «/2 and |ba— h] < «/2 hold 
for n>k. We add both these inequalities under the 
sign of absolute value. We obtain 


[(@n + bn) —(g +h)| <E. 


This means that the sequence with general term Cn = an + bn 
is convergent to the limit g+ h. Thus, we have proved 
the formula (6). 

In particular, if b„ takes a constant value: b, = C, 
formulae (6) and (3) imply: 

(10) lim(a,+¢) =¢+lima,. 

Now, we shall prove the formula (8). We have to 
“estimate” the difference |a,b,—gh|. To be able to apply 
the convergence of the sequences a@,, az, ... and bi, dg, ... 
we transform this difference as follows: 

An bn — gh = Anby— anh + anh— gh = anlbn— h) + h(an— g). 


Since the sequence a,, a,,... is convergent, it is bounded 
and so a number M exists such that |an] < M. Applying 
to the last equation the formulae for the absolute value 
of a sum and of a product we get: 


| Qn bn — gh] <s |an(bn—h)| + |h (an—g)| 
< M: |bn—h|+|h|-lan—gl- 


Now, let us take a number 7 > 0 independently of e. 
Hence a number k exists such that we have ja,—g|< 7 
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and |b,—h| < n for n > k. Thus, 
|anbn— gh] < Mn + |hly =(M+Ihl)7. 


Til now we have not assumed anything about the 
positive number 7. Let us now assume that 7 = e/(M+|h)). 
So we conclude that the inequality |a,b,—gh|< « holds 
for n > k. Thus, we have proved the formula (8). 

In particular, if we write 5, = c¢ we get 
(11) lim(c¢- an) = clima, , 
(12) lim(—a,) = — lima, , 
where the formula (12) follows from (11) by the sub- 
stitution ¢ = —1. 

Formulae (6) and (12) imply the formula (7), for 


lim (an — bp) = lim [an + (—ba)] " 
= lima, + lim (—bn) = lima, — lim}, . 


Before proceeding to the proof of the formula (9), 
we shall prove the following special case of this formula: 


(13) tim z E (when limb, + 0). 

First, we note that for sufficiently large n the in- 
equality b, = 0 holds. We shall prove an even stronger 
statement: we have |b,|> 4|k| for sufficiently large n. 
Indeed, since 4|h|>0, a number k exists such that 
lon —h| < $|h| for n> k. Hence, 


|h|—|bn] <[h— bn] < $A] and thus [d,|> 4/Al. 
To prove the formula (13), the difference 


1_ 1) _|h—b,| _ |h—bn] 
bn hl | h-On | [Af nl 


has to be estimated. 

But for sufficiently large n we have |h—b,| <7 and 
[bn] > blh], ie. 1/b,| < 2/|h|. Thus, ` 
pe ea 
bn h hz ` 


2 INFINITE SEQUENCES 35 
Writing n = }ch?, we get 
1 1 


db, h 


<E, 


whence the formula (13) follows. 
The formula (9) follows from (8) and (13): 


>. ün 1 : . 1 lima 
lim T = lima, limy- = imh 

Remarks. («) We have assumed that the sequences 
{an} and {bn} are convergent. This assumption is essential, 
for it may happen that the sequence {an+ bn} is conver- 
gent, although both the sequences {an} and {bn} are di- 
vergent; then the formula (6) cannot be applied. As an 
example one can take: a, = n, bn = —n. 

However, if the sequence {a,-+),} and one of the 
two sequences, e. g. the sequence {a,} are convergent, then 
the second one is also convergent. For bn = {an +brn)— an, 
and so the sequence {ba} is convergent as a difference 
of two convergent sequences. 

Analogous remarks may be applied to the formulae 
(7)-(9). 

(8) In the definition of a sequence we have assumed 
that the enumeration of the elements begins with 1. 
It is convenient to generalize this definition assuming that 
the enumeration begins with an arbitrary positive integer 
(and even with an arbitrary integer), e.g. with 2, 3 or 
another positive integer. So is e.g. in the proof of the 
formula (13). We have proved that b, # 0 beginning with 


a certain k. Thus, the sequence 5 is defined just beginning 
n 


with this k (for if bn = 0, then = does not mean any 
number). 

This remark is connected with the following property 
of sequences, easy to prove: the change of a finite number 
of terms of a sequence has influence neither on the con- 
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vergence of the sequence nor on its limit. The same can be 
said of the addition or omission of a finite number of 
terms in a sequence. 


EXAMPLES. Find lim cae In this case we cannot 


n= Tn —3° 
apply the formula (9) directly, since neither the numerator 


nor the denominator are convergent, as n tends to oo. 
However, we can transform the general term of the 
6n +2 
in—3 
pressions each of which has a limit. For this purpose 
it is sufficient to divide the numerator and the deno- 
6+2/n 
7—3/n 


sequence an = to become a quotient of two ex- 


minator by n. Then we obtain a, = and we may 


apply the formula (9). Since 


lim (6+ Ž) = 6 and lim (7-5) =7, 


n= n= 
we have 
; 6 
lim a, = =. 
N==00 í 
Similarly, 
1 1 
n+1 n i ne 
lim —— wal = li ar =?, 
n=00 n= 1 fe — 
n 
for 
lim = =0 =lim Ł. 
N= 00 n nao nN 


2.5. Further properties of the limit 


Suppose that a sequence {a,} is convergent. Then the 
sequence {(a,|} is convergent, too, and 


(14) lim|a,| = [lim an| . 


Let lima, = g. Then we have |a,—g| < e for sufficiently 
large n. Thus, 


|@nl—|g]<|@n—g|<e and |g|—|an|<|g—an|<e, 
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whence (cf. § 1 (17)): \|an!—1g|\ < £. Thus, the formula (14) 
is proved. 

Assuming the sequences {ap} and {bn} to be con- 
vergent, the following relation holds: 
(15) the inequality an <b, implies lima, < limb, . 

In particular, if the sequence {cn} is convergent, then 
(16) the condition ¢, > 0 implies lime, >0. 


We shall prove first the last formula. Let lifer = h, 
and let us further assume that h < 0, i.e. that —h> 0. 
Then we have |en— h| < —h for sufficiently large n, and 
hence ¢,—h < —h, whence cp < 0, which contradicts our 
assumption. 

Applying the formula (16) we shall prove now the 
formula (15). 

We put ba—an = Cn. Since a, < ba, we have Cn >0 
and thus, in the limit, lime, > 0. Moreover, (7) implies: 


lime, = lim bp — lima, , 
hence 
limb,—lima, >0, ie. lima,<limb. 
Remark. In the formulation of the relation (16), the 
inequality > cannot be replaced by > (similarly, in (15) 
one cannot replace < by <). For example the sequence 
Cn = 1/n satisfies the inequality cn > 0, but lime, = 0. 
Thus we see that the relations < and > “remain 
true in the limit”, but the relations < and > do not 
possess this property. 
We next prove the formula of the double inequality: 
(17) If an <n Sbn and if lima, = limb,, then the se- 
quence {cn} is convergent and lime, = lima, = lim bp. 


Suppose that lima, = g = limb, and let «> 0. Then 
we have |a,—g| < ¢ and |b, —g| < e for sufficiently large n. 
According to the assumption, 


an— g SOn—G <bn—-g, 
and —e<a@—g and bnr—g <£; 
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hence —e < ¢,—g < £, i.e. |¢,—g| < e, whence lime, = g. 


(18) If limla,| = 0, then the sequence {an} is convergent 
and lima, = 0. 


For, we have then —|a,| < an < |an! and 
lim (—|an|) = 0 = lim|a,|. 


2.6. Subsequences 


Let a sequence dı, az; ...; Ang.. and an increasing 
sequence of positive integers Mı, Ma, ..., M%n,... be given. 
The sequence 


bi = am,  bDz= am, +) On = Om; 
is called a subsequence of the sequence 1, az, ...5 Any .. 
For example the sequence az, a4, ..., den, -~ 18 & sub- 
sequence of the sequence a, aa, ... Yet, the sequence a,, a, 
Qz, G,... is not a subsequence of this sequence, since in 
this case the indices do not form an increasing sequence. 
We have the general formula 


(19) mmn. 


This is obvious for n = 1, i.e. we have m, > 1 (since m, 
is a positive integer). Applying the principle of induction, 
let us assume that the formula (19) holds for a given n. 
Then we have Mny > Mn > Nn, whence Mny > n++1. So we 
have obtained the formula (19) for n+1. Thus, the for- 
mula (19) is true for each n. 

According to our definition, every sequence is its own 
subsequence. We can say in general that every sub- 
sequence is obtained from the sequence by omitting 
a number of elements in this sequence (this number may 
be finite, infinite or zero). Hence it follows also that 
a subsequence {Amy} of a subsequence {am} is a sub- 
sequence of the sequence {an}. 

THEOREM 1. A subsequence of a convergent sequence is 
convergent to the same limit. In other words, 


(20) if lim @ = g and if m < m,<..., then lim am, = 9. 


m=00 
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Let a number «> 0 be given. Then a number k exists 
such that the inequality |an—g| < £ holds for n> k. Ac- 
cording to the formula (19), m, > > k; hence |am,— g| < €. 
This implies lim a», = g. 

nm 


THEOREM 2 (BOLZANO-WEIERSTRASS (1)). Every bounded 
sequence contains a convergent subsequence. 


Proof. Let the sequence {a,} be bounded. Then 
a number M exists such that the inequality —M < an < M 
holds for each n. 

We shall now apply the theorem from § 1.7. Suppose 
that we denote by Z the set of numbers x for which the 
inequality x < an holds for infinitely many n. The set Z 
is non-empty, since the number —M belongs to Z (be- 
cause the inequality —M <a, is satisfied by all n). At 
the same time this set is bounded above; for, if x belongs 
to Z, then s< M, since assuming x > M, the inequality 
8 < a, would not be satisfied by any n (thu. the number x 
could not belong to the set Z). 

Since the set Z is non-empty and bounded above, 
the upper bound of this set exists. Let us denote this 
bound by g. It follows by the definition of the upper 
bound that to any number «> 0 there exist infinitely 
many n such that 

J—E << dn SGte 


(because g—e belongs to the set Z and g+e does not 
belong to Z). 

We shall now prove that g is the limit of a certain 
subsequence of the sequence {a,}. Thus, we have to define 
a sequence of positive integers M, < M, < My < ... in such 
a way that lim am, = g. 

For this "purpose we shall first substitute 1 in place 
of «. Then there exist infinitely many n such that 


g—-1l<a,<g+1. 


(1) Mathematicians of the 19th century. Karl Weierstrass is 
one of the greatest analysts. 
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Denoting one of these n by m,, we have 
g-l<a4,,<g+1. 


Now, let us substitute «= 4. Then there exist in- 
finitely many n such that g—}4 < an <Sg+4. Among 
these n there exist numbers > m,; someone of these n 
we denote by m,. So we have 


9-4 < am Sgt}, M<mM,. 
Similarly, we can find an index m, such that g—}4 
< üm, <9Y+4, My < Mz. 
In general, if m, is already defined, we define m,,, in 
such a way that 


1 
(21) J—-—a < Om, SI Mn < Mn+1- 


n+l n+1’ 
We shall apply formula (17) on the double inequality. 


Since lim = 0, we have 
1 . 1 
lim (g— z) = g = lim (s+ z) k 


Hence the formula (21) (after replacing n +1 by n) implies 
lim am, = g. Finally, it follows from the inequality m, 


Maco 

<™Mn+1 that the sequence @m,,.4m,,-.. is a subsequence 

of the sequence ai, a@,,... Thus, the theorem is proved. 
As a corollary from the above theorem we shall deduce 


THEOREM 3. Every monotone bounded sequence is con- 
vergent. Moreover, if a,<a,<..., then a, <lima,; tf 
a, >a,>..., then a, > lima,. 

Let us assume the sequence {a,} to be bounded and 
increasing in the wider sense. Let us denote by Z the 
set of numbers belonging to this sequence and by g its 
upper bound (cf. § 1.7). Then we have 


g>a, for each n; 
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at the same time for any «> 0 there exists a k such that 
g—é< a (because the inequality g— £ >a, cannot hold 
for all n, as follows from the definition of the upper bound). 

Since the sequence {an} is increasing (in the wider 
sense), the inequality n> k implies a, <an, whence 
g—&<a,. Thus we conclude that to any «> 0 there 
exists a k such that for n > k the double inequality 
g—-&<@n<g holds and so the inequality |ja,—g|<« 
holds, too. This means that g = lim ay. 


n=0 

To prove that the inequality an < g is satisfied by 

each n, let us consider a fixed positive integer n. It has 

to be proved that am, < g. Now, it follows from the 
assumptions that 


Ang “S Angt15 Ano S Ano+2s «es Ang S Anotks + 
Thus by the formula (15), an, < lim an+k = J. 
k= 


In this way the Theorem 3 is proved for non-decreasing 
sequences. The proof for non-increasing sequences is 
analogous. 

It follows at once from Theorem 1 that a convergent 
sequence cannot contain two subsequences convergent to 
different limits (especially, this implies the divergence of 
the sequence 0,1,0,1,...). For bounded sequences, this 
theorem may be reversed. Namely, we have 


THEOREM 4 (1). If a sequence {an} is bounded and if 
all subsequences of this sequence are convergent to the same 
limit g, then the sequence {an} is convergent to the limit g. 

In other words, every bounded divergent sequence con- 
tains two subsequences convergent to different limits. 


Proof. Let us suppose that g is not the limit of the 
sequence {an}. Then a number «> 0 exists such that for 
every k there exists n >k such that the inequality 
|an—g| > e holds. Hence we conclude that a subsequence 
{4m,} exists such that |am,— g| > £ for every n. By sub- 


() We shall apply this theorem in § 5.5. 
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stituting the value 1 in place of k we find that there 
exists m, > 1 such that |am,— g| > £. Further, substituting 
k = m, we find m, > m, for which |am,—g| > £. Similarly, 
there exists Mm, > m, such that |an,—g| > € ete. 

Since the sequence {an} is bounded, the sequence 
{4m,} is also bounded. Hence, by the Bolzano-Weierstrass 
theorem it contains a convergent subsequence. Let us 
denote this subsequence by {am, 3- Since it is also a sub- 
sequence of the sequence {an}, our assumptions imply 

lim am, =9, i.e. lim(an, —g) =0. 
nmo Nn==00 

But, on the other hand, the numbers m,,, m,,, ... belong 
to the sequence Mı, m,.,... and, consequently, the in- 
equality |@n,—g| >£ implies the inequality |am, —g|>e 
for each n. This contains a contradiction. 

So we have proved that lima, = g, by leading to 


Ræ 


contradiction. 


2.7. Cauchy theorem £) 

A necessary and sufficient condition for the convergence 
of the sequence {an} is that for every e > 0 a number r exists 
such that the inequality 


(22) |dn—a,| < € 


holds for n>r. 

The proof consists of two parts. In the first one we 
shall prove that the convergence of a sequence implies 
the condition formulated in the theorem, the so-called 
“Cauchy condition”; in other words, we shall prove that 
this condition is a necessary condition for the convergence 
of this sequence. In the second part we shall prove that 


(1) Augustin Cauchy, 1789-1857, one of the most eminent French 
mathematicians. The establishing of fundamental notions and theo- 
rems of the theory of sequences and series and of the theory of 
continuous functions is due mostly to him. 
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if the Cauchy condition is satisfied, then the sequence is 
convergent, i.e. that it is a sufficient condition for the 
convergence of the sequence. 


1° Let liman = g and let «> 0 be given. Then a num- 
ber r exists such that |an—g|< $e holds for n >r. In 
particular, this inequality holds for n = r, i.e.|a,—g|< de. 
Adding both these inequalities under the sign of the ab- 
solute value we obtain the formula (22). 

2° Now, let us assume the Cauchy condition to be 
satisfied. We have to prove the convergence of the se- 
quence. First of all we shall prove that it is a bounded 
sequence. The proof will be analogous to the proof in § 2.3. 
Namely, we substitute e = 1. Then a number r exists such 
that we have |a,—a,|<1 for n>r. Hence |an|—|a,| 
< |an— a| < 1, whence |an| < |a,|+1. Let us denote by M 
a number greater than anyone among the following r 
numbers: |a|, |@|, ..., |@--1|, |ar| +1. So we have M > |an| 
for each n. This means that the sequence {an} is bounded. 

Hence we conclude by the Bolzano-Weierstrass theorem 
that this sequence contains a convergent subsequence. 
Thus, let lim am, = g, where Mm, < Mm, < ... We shall prove 


Nm 


that g = lim an. 


N00 
Now, let €> 0 be given. According to the Cauchy 
condition, a number r exists such that the inequality 


(23) |an— a| < te 
is satisfied for n >r. 
The equation lim am, = g implies the existence of a k 
such that we hace 
(24) [am — g| < $e 
for n > k. Clearly, k may be chosen in such way that 


k >r. Then both inequalities (23) and (24) are satisfied 
for n> k. 
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Moreover, one may replace in formula (23) n by ma, 
since Mr >n>r (ef. (19)). This gives 
(25) {Amy — ar| < fe. 

Adding the inequalities (23)-(25) after changing the 
sign under the absolute value in (25), we obtain the 
inequality |a,—g|< £, valid for each n > k. This means 
that limar = g. 

Remarks. («) In the Cauchy theorem as well as in 
the definition of the limit the sign > in the inequality 
n> k as well as the sign < in the formula (22) may be 
replaced by > and <, respectively. 

(8) The Cauchy condition may be also formulated as 
follows: for every ¢>0 a number r exists such that the 
conditions n >r and n’ >r imply |an—aw|< e. 

Namely, the Cauchy condition implies the existence 
of an r such that the inequalities |an— a |< łe and 
jann— a| < $e hold for n>r and n’ >r. Adding these 
inequalities we obtain |an— an] < e. 


2.8. Divergence to co 


A sequence {an} is called divergent to co, if to every 
number r there exists a positive integer k such that 
an >r for n>k. We denote this fact symbolically by 
the equation: lima, = oo. Thus, a sequence divergent 


N00 
to oo is a sequence, in which those terms with sufficiently 
large indices are arbitrarily great. 

Analogously we define the meaning of the expression 
lim a, = —oo. It means that for every negative number r 
N=Co 
there exists a k such that an <r for n>k. 

We say that sequences divergent to co or —co have 
improper limits. 

EXAMPLES: lim n = œ, lim (—n) = — o. 


Nm n=00 


1. An increasing (in the wider sense) sequence, un- 
bounded above, is divergent to co. 
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Indeed, since the sequence {an} is unbounded above, 
there exists for any r a number k such that an > a, for 
n > k, whence an >r. Thus, lim an =oo. 


n=% 

An analogous theorem holds for decreasing sequences. 

Comparing this theorem with Theorem 3, § 2.6, we 
conclude that every monotone sequence has a limit, proper 
or improper (depending on whether it is bounded or un- 
bounded, respectively). 

2. If Um an = +00, then lim (1/an) = 0. 

Tm n=oo 

Namely, let liman = co and let e > 0. Writing r = 1/e 
we conclude that there exists a k such that a, > lje 
holds for n> k, i.e. 1/an < £ for n > k; but this means 
that lim(1/a,) = 0. 

The converse theorem is not true: the sequence 
1, —4, 4, —},... converges to 0 but the sequence of its 
reciprocals 1, —2,3, —4,... is divergent neither to + co 
nor to — oo. 

Let us mention the following theorem concerning 
operations on divergent sequences: the sum and the product 
of two sequences divergent to +00 are divergent to +00. 
We shall prove this theorem in the following form which 
is a little stronger than the above: 


3. If liman = œ and if the sequence {bn} is bounded 


Namely, let M < bn. Since lima, = œ, then for 
a given r there exists a number k such that we have 
an > r—M for n > k. Hence an+ bn > r and, consequently, 
lim (an + bn) = o0. 


4. If lima, = co and if bn >c always, where e> 0, 
then lim (ar: bn) = co. 


Let a number r > 0 be given. There exists a number k 
such that for n> k, we have a, > r/c. Multiplying this 
inequality by the inequality bn >c we obtain anbn >f. 
Hence lim(dn- bn) = co. 
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A theorem corresponding to theorem (15) is the follow- 
ing one: 

5. If iman = œ and adn < by, then limb, = œ. 

Namely, if a, >r, then still more b, >r. 


2.9. Examples 
(a) If c>0, then lim ne = œ. 


This follows immediately from 4. 
(8) If a>1, then lim a” = oo, 


Rm oo 
Namely, writing ¢=a—1, we get c>0, whence 
lim ne = oo. On the other hand, applying the Bernoulli 


N= 
inequality (§ 1 (1)), we obtain 
a" =(1+c¢)">1+nc, whence lima™= oo 


according to 5. 
(y) If |g} <1, then limg* = 0. 


First, let us assume that 0<q<1. Then l/g>1 
and, consequently, lim (1/q”) = oo. Hence we obtain, ac- 
Nw 


cording to Theorem 2, lim gq = 0. 


Mm00 

Hence it follows that in the general case, assuming 

only j|g|<1, the equation limļq} =0 is satisfied, 
n= 

i. e. lim |q"| = 0. But the last equation implies lim g” = 0 

N00 Naco 
(cf. (18)). 

(8) If a> 0, then lim Va =1. 

n00 

First, let us assume that a>1 and let us write 
Uy = ya. We shall prove that the sequence {u,} is de- 
creasing. Indeed, a > 1 implies a” < a™!, Taking on both 
sides the n(n+1)-th root we obtain Hya < V4, i.e. 
Un > Uni» Moreover, the sequence {un} is bounded since 
Un > 1. Hence we conclude that it is a convergent se- 
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quence (cf. 2.6, Theorem 3). One has to prove that 1 is the 
limit of this sequence. Let us write lim u„ = 1-+h. By 
the above cited theorem, uw, > 1 implies k > 0. We shall 
prove that the supposition h > 0 leads to contradiction. 
Indeed, the inequality 1+h <Va yields (1+h)"<a 
and since (1+h)">1+h, we conclude that 1+-nh<a 
for each n. But this is impossible, since lim nh = oo. 


M00 


So we have proved that a> 1 implies lim ya =1. 
T= 00 


But if 0<a<1, then 1/a>1 and lim)i/a = 1, i.e. 


N= 0O 


lim (1//a) = 1. Hence 1/lim Va = 1, ie. lim Va = 1. 
N= næ 


Mm 0O 


(e) If |q| <1, then lima(1+qt@+..+¢") =i 
= CO 

This is the expression for the sum of the geometric 
progression with a quotient whose numerical value is less 
than unity. 

Namely, we have 1+q+@+..4¢ qt = e and 
limg” = 0 (cf. (y)). 

(€) If a > 0 and if {r,} is a sequence of rational numbers 


convergent to zero, then lima™ = 1. 
næ c0 


This is a generalization of the formula (8) and it is 
easily deduced from this formula. 


2.10. The number ¢ 

We shall prove the existence of lim (2 + sy We shall 
denote this limit by e. j 

Let us write an = (1+ zy. Then we have 


a, =2, a, = (1+4) =}, ds = (1+4 = $4 = 24}. 


We shall prove that this sequence is increasing. For 
this purpose we shall apply the Newton binomial 
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formula (§ 1.3): 


= 1 , n(n—1) 1 n(n—1)-...-1 1 
m=l+nz + 1-2 pT 1-2... n 1 
=i (Bd 
1+1+ 4 a ae 
(1-=)-.....-"—} 
+ n! ? 
hence 
eA anal) 
1 1 1 
ann = 1+ Lh — pe Et 
1 n—1l 1 n 
edee aa a 
n! ' (n +1)! i 


It is easily seen that the terms of the sum consti- 
tuting a, are less than or equal to the first terms consti- 
tuting anı, respectively. Hence an < any. 

Thus, the sequence is increasing. But it is also bounded, 
for 


1 1 1.1 1 
a< 2+ gte by Set gtagte tga <3) 
since (cf. § 2.9, (e)) 
1,1 1 %3 
atate taast 


The sequence {an}, being increasing and bounded, is 
convergent. Hence the existence of the number e is al- 
ready proved. It can be calculated that, approximately, 
e = 2,718... We may also prove (as we shall show later) 
that 

e =üm(1+ pta t ; 


Neco 
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The number e plays a great part in analysis. In par- 
ticular it is used as the base of logarithms (so called 
natural logarithms). 

We shall now prove that 


(26) lim (1- y a 
n=00 n € 
Indeed, we have 
1 n-i 1 1 
aS n n in) .. 2? 
("| Ker n—1 


N=00 —1 
1 1 1 
z Pad tes ert 
tim (14+ 5"5)" tim (14+ 555] 
for 
lim (1+ al 


2.11*. The sequences of the arithmetic means and of the 
geometric means of a given sequence 


Given a sequence 4, Az; ..., Gn, ..., let us consider the 
sequence of the arithmetic means 


A, + A, Ay + Ag+... + An 


a vee oe 
1) 9 ’ ’ n ’ 


1. If lim a, = g, then lim = g; this theorem 


n=00 n=00 


remains true in the case g = +o. 


Qi +- +H an 
n 


Proof. First, let us assume that g is a finite number. 
Then, for a given e > 0, a number k exists such that the 
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inequalities 
Q— E< Mg CIJHE, Gr-te< dina <gte, 
vey J-EKOn<gt+e 
are satisfied for each n> k. 
Adding the system of these n— k inequalities we obtain 


OK+1 +... 4+ On 
n 


g-ée< SE 


<gt+e, 


i.e. 


n—k | Apart... tan n—k 
We SS Gi eee 


At the same time, lim = 0, whence we 


a, + eee + a 
Nw n 

a eee a 

< at + dy 
n 


have —e <e for sufficiently large n. Hence 


n—k a+.. +a n— 
—e< tut 


k 
<(g+e) a tE, 


(g—e) 


but since lim 2—4 = 1, we have 


n=% 


g—3e < 


for sufficiently large n. 


This means that lim attan =g. 


NwO0 
Now, let us assume that g = oo (the proof in the 


case g = —oo is analogous). Then for a given number 
r > 0 a number k exists such that akı > f, G42 >T; o 
Thus, we have akı +... +4an >(n—k)r for each n> k, 
whence 


Angi te. Fan _ n—k 


Sa Ns 
n n 
But we have ateta > —5 for large n; whence 
Q,+...+4, _ n-k ror k 
aa e T ogee 
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Ay +... + an x r 


3 for sufficiently large n. 


whence we obtain 


Hence we conclude that 


lim a +... + an Dg 
m=00 n 
Remark. The converse theorem is not true: a se- 
quence may be divergent although the sequence of its 
arithmetic means is convergent. For instance, the se- 
quence 1,0,1,0, ... is divergent but the sequence of its 
arithmetic means is convergent to }. 
An analogous theorem holds for the geometric means: 


2. If a, > 0 and lim a, = g (g finite or infinite), then 
n= 


lim Vaaz. -° On =g. 
n=0 
This theorem is proved in a manner completely ana- 
logous to the proof of Theorem 1. Theorem 2 may be 
also reduced to Theorem 1 by taking logarithms (applying 
the continuity of the function logx, cf. § 5.5). 
3. If lim (an+1— an) = g, then lim “t =g. 
Indeed, let us write bn = an—đân-ı for n>1 and 
b, =a. Then we have 


lim b, = and = ————_- = 
n=00 n 


Hence lim =g by Theorem 1. 
n=0o0 


4. If dn > 0 and lim “"+? =g, then lim Va, = g. 


n=co On n=% 


This theorem is obtained from Theorem 2 writing 


bi = — for n>1 and b,=a,; it follows from the 
n—1 


equation j/b,b,-...- bn = Van. 
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EXAMPLES. («) Writing a, = n, we have lim n+l = 1. 


nm 
Hence lim Vn = 1. 


n=% 


(n+1)! 
! 


(B) lim yn! =o, for lim = lim (n+1) = o0. 
n= n=% N n=00 


(y) The example of the sequence 1,1, 4, 4, },},... 
shows that the limit lim Van may exist, although the 


n=O 


limit lim +! does not exist. 


n=œ On 


Exercises on § 2 
1. Evaluate the limits: 


í n . ont+l 
amarg? ae In—2?’ 
me 2 D2 1 2 
li 2n?+5 lim 2 +22?-+..+% 


n=% 3n? are 1 7 næ n? 


2. Let a convergent sequence {ap} be given. Prove that, 
if we replace a finite number of terms of this sequence 
by other terms, the sequence obtained in this way is 
convergent, too, and has the same limit as the given 
sequence. 

Similarly: cancellation or addition of a finite number 
of terms to a sequence has influence neither on the con- 
vergence of the sequence nor on the value of its limit. 

3. Prove that if lima, = 0 and if the sequence {bn} 


Nao 


is bounded, then lim a,b, = 0. 


n= 
4. Prove that if the sequences {an} and {bn} are con- 
vergent to the same limit, then the sequence a@,, b1, az, be, ... 
is convergent to this limit, too. 


5. Prove the following generalization of the theorem on 
the limit of subsequences (§ 2.6, Theorem 1): ¿f lim a, = g 
n=% 
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(where g has a finite or infinite value) and if lim m, = ©, 
N00 


then lim am, = 9. 


6. Evaluate lim lym. 


n=00 


7. We define a sequence {an} by induction as follows: 


An—1 + Gn—2 
a,=0, a=1, ûn = a ae 


ad 


Prove that lim a, = 2. 


Tex 00 


8. Let a bounded sequence {a,} be given. Prove that 
among the numbers being limits of convergent subse- 
quences of this sequence there exist the greatest number 
and the least number (these numbers are called limes 
superior and limes inferior of the sequence {a,}, i.e. the 
upper limit and the lower limit of the sequence {an}, 
respectively). 

Prove that a necessary and sufficient condition of the 
convergence of a sequence is that the upper limit equals 
the lower limit. 

Prove that if c = limsupa,, then for every «> 0 
a number k exists such that a,<c+e for n>k and 
that a, > ¢—e holds for infinitely many indices m. 


9. Prove that for every sequence of closed intervals 
such that each interval is contained in the preceding 
one, there exists at least one common point (Ascoli 
theorem). 


In the above theorem closed intervals are considered, 
i.e. intervals together with end-points; show by an ex- 
ample that this theorem does not hold for open intervals 
(i.e. intervals whose end-points are excluded). 


10. Find the limit of the sequence {an} defined by 
induction: 


@,=VC, On4,= Votan. 
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11. Prove that if lim a, = g and if lim (b, + bz +... + bn) 


= oo, where always b, > 0, then 
. 4,0, + a,b, +... + and 
i 171 272 n We: 
ara D u edn á 


12. Prove that if lim "r — g and lim » = ©, 


Nao Yn Un-1 n=00 


where the sequence {vn} is increasing, then lim —* = g. 


N00 n 
: . f ; Un — Un— 
(Substitute in the previous exercise: a, = er ae a Le 
nn Un- 


bn = Un — Vr-1). 
13. Pascal (4) triangle. We consider the following 
table (i.e. double sequence {a,;}): 


Lode As oY Ae 
123 4 5.. 
1 3 610 15. 
1 4 10 20 35.. 
1 5 15 35 70.. 


Po cssosaso‘lo 


This table is defined as follows: the first line consists 
of nothing but 1, ie. a,, = 1; the k-th term in the n-th 
line is the sum of the first k terms of the (n —1)-th line, i.e. 


ank = An—11 + On-1,2 + + + Anik « 
Prove that 
Pr (kK+n— 2)! 
nk — (k—1)!(n—1)! 
and that the terms an1, Gn-1.2,-.-) in are successive 
coefficients of the Newton expansion of the expression 


(a+b) (as is easily seen they are the terms of the 
table lying on the straight line joining the n-th term 
of the first line with the first term of the n-th line). 


(@) Blaise Pascal, a French mathematician, 1623-1662, known by 
his works which initiated the Calculus of Probability. Newton’s 
predecessor in certain researches in Analysis. 


2. INFINITE SEQUENCES 55 


14. Prove that 


15. Prove that if a sequence of rational numbers 
[n (where p, and qna are positive integers) tends to an 
iene number, then 


lim pn = œ = lim qn. 
n=% n= 


§ 3. INFINITE SERIES 


3.1. Definitions and examples 


Given an infinite sequence a, az, -y Any... WE CON- 
sider the following infinite sequence: 


(1) 8, = ay, 8 = di + az, -3 Sn = A, Haat. tan, 


If the sequence 8,, Sa; -3 Sny- has a limit, then we 
denote this limit by the symbol 


Ms 


An = lim 8, 


n=1 n=% 


y 


and we call it the sum of the infinite series a+ a+... + 
+a,+... 

In this case we say also that the series is convergent. 
If the above limit does not exist, then the series is called 
divergent. 

In the case when all terms of the sequence {a,} be- 
ginning with a certain k are = 0 we have an ordinary 
sum of a finite number of terms. Thus, the sum of an 
infinite series is a generalization of this sum when the 
number of terms is infinite (which is emphasized by 
the notation). However, in distinction with the addition 
of a finite number of terms, it is not always possible 


56 I. SEQUENCES AND SERIES 


to find the sum of an infinite number of terms, i.e. the 
sequence (1) is not always convergent (even if we take 
into account infinite limits). 

To illustrate this we shall give several examples. 

The geometric series a+aq-+aq?+...taq™+... with 
the quotient q satisfying the inequality |q] < 1 is con- 
vergent. Namely (§ 2.9, (e)), 

A Ca ee ceed ae 

The series 1+1+1+... is divergent to co because 
Sp =^. 

The series 1—1+1—1+... has neither a proper nor 
an improper limit, for in this case the sequence (1) is 
the sequence: 1,0,1,0,. 

The sequence {s,} will be called the sequence of partial 
sums of the given infinite series. 

By the n-th remainder of the series a,+a,+... we 
understand the series 


(2) Tn = Antit Inset. = A Am » 


Tf the series a, +a@, +... is convergent, then lim f = 0. 
n=00 


First of all let us note that if the series a,-++a,+... 
is convergent, then the series (2) is also convergent for 
each value of n. For 


Tn = pi N (an1 + On+e +t an+k) = = nn N Sn+k 8) >= 5 Am— Sns 


m=i 
whence 
lim fp = 2 dm — lim 8m = S am — 5 am = 0. 
N=00 Mul m=) 


3.2. General properties of series 


We shall now give some properties of infinite series 
which are direct consequences of relevant properties of 
infinite sequences. 
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1. CAUCHY CONDITION. A necessary and sufficient con- 
dition for the convergence of the series a,+a,.+... is that 
for every e>0 a number k exists such that the inequality 


(3) |ak+1 + Ange + -+ akym] < E 
holds for each m. 


Indeed, the convergence of the given series means 
the convergence of its partial sums 8, 8,..., and the 
Cauchy theorem (§ 2.7) implies this sequence to be con- 
vergent if and only if for every «> 0 there is ak such 
that for each m the inequality |8:4m—S|<e (ie. the 
inequality (3)) is satisfied. 

2. If the series a,-+a,+... is convergent, then lim a, = 0. 


n=00 
Namely, an = Sn— Sn-1; hence 


lim a, = lim sp — lim Sp~1, 


Nexo Nr CO N= Oo 
but 
lim 8, = lim S,-1. 
n=00 N=0O 
Remark. Theorem 2 cannot be reversed. Namely, 
there exist divergent series with terms tending to 0. Such 
a series is the harmonic series 


1,1 1 
Lt gtgtee tote 


Indeed, 

Lid. Dae a 

aa" a a a g ane 
1 1 Toa 
eth EE eee 
myi aya" +1” g? 


i.e. 
Sonti — Son > 4 . 


n 2 
Hence Son > 5: Thus lim 8,, = œ, whence we conclude 
N= 00 


that the sequence of partial sums of the harmonic series 
and so the series itself, are divergent. This is a series 
divergent to oo. 
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A series is called bounded if the sequence of its partial 
sums is bounded, i.e. if a number M exists such that 
M>|s,| for each n. 

3. Every convergent series is bounded. 

This is an immediate consequence of theorem § 2.3. 

We shall give now two theorems relating to operations 
on series: 

4. If the series a,+a,+... and b,+b,+... are con- 
vergent, then 


>, (an + bn) = D n+ Dba 
n=l n=l Neel 
È (an— bn) = D>, & — Dy, vai 
næ] n=1 n=l 


For 


Dy (an tbn) = lim (m, + By + as + baH oe + n+ On) 


n=l 


= lim (a, + a +... + an) + lim (b, +b +... + Dn) 


n=% 
oo [es] 
-Š mt So, 
n=l n=1 


The proof for the difference is analogous. 
5. If the series a,+a,+... is convergent, then 


> (c-a) = 6: Y an. 


Nea] n=1 

In particular, 
D> (—@,) = — >, Ox 
n=1 n=1 

For 

Co 
>» (C+ an) = lim (c-a, +0: a, +... +C: an) 
n=1 TAO 


oo 


= c- lim (a, + aa +... + an) = 0° » ay. 


næ nel 
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3.3. Alternating series. Abel theorem 
We call alternating series a series of the form 
(4) a,—A,+A,—%+..., Where a,>0. 


THEOREM 1. An alternating series (1) satisfying the 
conditions 
(5) €,>a,>a,>.. and lima,=0 
NCO 
is convergent. Moreover, the partial sums 8s, = a@,—a,+ 
+az— a, +... tan satisfy the inequalities 


(6) Son < A1 — Ag+ Ag—... SX Sonti- 


Indeed, the sequence of partial sums with even indices 
is increasing (in the wider sense), for 


Son+2 = Son + (on41— Gon+2) and Gon+1— an2 Z O. 
At the same time, it is a bounded sequence, since 
Son = Q — [(a2— 43) + (44 — as) +... + an] Sa. 


Thus, it is a convergent sequence. Let lim 8, = g. 
n= 


To prove the convergence of the series (4), it suffices 
to show that lim s,,, = g. 


Now, Sen41 = Sen + Qon41, Whence lim Sanyi = lim Son + 
n=% 


n=0 


+lim deny. = g, because lim @en,; = 0 by (5). 


Neo 
Finally, the double inequality (6) follows from the 
fact that the sequence {Sən} is increasing and the sequence 
{Sen4i} is decreasing (cf. § 2.6, Theorem 3). 
EXAMPLES. The (anharmonic) series 


(7) L—$+ 3—4+... 
is convergent. As we shall show later, its sum equals 
to log,2. 
The series 
(8) 1—$+4—-++... 


is also convergent (its sum is equal to r). 
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THEOREM 2 (ABEL ()). If the sequence {an} satisfies the 
conditions (5) and if the series b,+6,+... (convergent or 
divergent) is bounded, then the series 
(9) aibi + azb +... + anban +... 
is convergent. 

Let us write s, = bı +b, +... +bn. According to the 
assumptions we have made there exists an M such that 
[Sn] < M. 

To prove the convergence of the series (9), we have 
to estimate the sum 

Oy, Dye + akti Bp 41 +- + Andy 
for n> k. For this purpose we note first that 
(10) —2M < bm + Omit... +b < 2M 
for each m and n > m, since 
[Bm +- + bn] = [Sn —8m—1] <|8n|+]8m—-1| < 2M. 
Now, 


(11) Oy, by + Oy Oey +e + On On 
= (A — O41) De + (Anta — ere) (Ox + brt) + 
+ (Qx42— ess) (De + Deer + Beye) + one + On(De + brt + 
+ ...4+0n) < 2M [( ay — ar41) + (0k41 — Ape) + +n] 
= 2Ma, 
according to (10). 
Similarly, a,b, -+...+4nb, > —2M-a,; hence 
(12) [ap De +... + an bn] <2M-a,. 
Now, let an £ > 0 be given. By the equation (5), there 
E€ 
23 
inequality (12), i. e. |a,b,+...+4nb,| < £, holds for each 
n > k. According to the Cauchy theorem (§ 3.2, Theorem 1), 


exists a k such that ap < As we have proved, the 


this implies the convergence of the series D>, anbn. 
n=1 


(¢) Niels Henrik Abel (1802-1829), a famous Norwegian alge- 
braician. 
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Remarks. («) It follows from the formula (12) that 


fo a] 
(13) | S anbn| <2M- a. 
n=] 

Namely, by the formula (12), the inequality |a,b; +... + 
+anbn| <2 M-a, holds for each n. 

(8) Theorem 1 is a special case of Theorem 2. Namely, 
we take the sequence 1,—-1,1,—1,... in place of the 
sequence {bn}. 

(y) In the formula (11) we have applied the so called 
Abel transformation. It may be written also in the follow- 
ing form: 


UV + oe + Um Vm = Uy(V,— Va) + (Ui + Ua) (Vg— V3) +... + 
+ (Uy +... + Umi) (Um—1 — Um) + (Uy +... + Um) Um - 


3.4. Series with positive terms. D’Alembert and Cauchy 
convergence criterions 


Assuming all the terms of the series a,+a,+... to be 
positive, the sequence of its partial sums is increasing. 
Hence it follows immediately that: 

1. A series with positive terms is either convergent or 
divergent to oo. 

2. THEOREM ON COMPARISON OF SERIES. If O< by <an 
always and if the series a,+a,+... is convergent, then the 
series b,+b,+... is also convergent. Moreover, 


Let Sn = @,+@,+...+4n, tn = bi +b.4+...+b,. Then 


fos] 
we have t, < 8s, and, since (cf. § 2.6, 3) 8, <lims, = » ay, 


n=0o n=l 


we have tp < J an. This inequality proves the bounded- 
< 


{i 
ma 
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ness and so the convergence of the series },+),+.. 
(by Theorem 1); on the other hand, it implies the in- 


oo fee] 
equality È bn < È an (by § 2.6, 3). 


Theorem 2 often makes it possible to prove the con- 
vergence of a series in a simple way, by comparison of 
this series with a series the convergence of which is al- 
ready established. For example to prove the conver- 
gence of the series 


(14 ite ee Sane PTE Hy Ae 
l rip to 
we compare it with the series 
1 1 1 
(15) Lataa t e Tama 


Namely, we have 


1 1 1 
252.3? “O (n +1) Santi 


At the same time the convergence of the series (15) 
follows immediately from the identity: 


1 1 1 1 1 1 
patsat~+ qo = (1-3)+G-3) +--+ 


whence lims, =1. 
T= 00 
The following two convergence criteria for series 
with positive terms are based on the comparison of the 
given series with the geometric series. 


2 
C) We shall show later (§ 11, (46)) that IFz T Ere = =. 


3 
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3. D’ ALEMBERT (!) CRITERION. A series a,+a,+... with 
positive terms satisfying the condition 


a6) ae 
is convergent. 

oh a (16) suppose that h satisfies the inequality 
hi +<h<1. Hence a number k exists such that for 
n= 


n 


im “241 

o 

n >k we have ora < h, i.e. Gna: < an’ h. 
n 

Thus, the series a@,+ đk+ı +48k+2 +... has terms less 


than the terms of the geometric series a,+a,-h+ 
+a,-h?+..., respectively. But the last series is convergent 
because 0< h< 1. Thus, Theorem 2 implies the con- 


co 


vergence of the series 2 a, and hence of the series 


n=k 
foo] 
> an, too 
n=1 


4. CAUCHY CRITERION. A series a+ a+... with positive 
terms satisfying the condition 
(17) lim Va, <1, 

Ne 00 
is convergent. 

Similarly as before, there exist an k < 1 and a k such 
that for n > k, we have Van < h, i.e. an < h”. Comparing 
the series a,+ 441+... with the geometric series h*+ 
+h*+14-..., we conclude the convergence of the first 
series from the convergence of the second one. 

5. DIVERGENCE CRITERIA. If the series a,+a,+... with 
positive terms satisfies one of the two inequalities 
(18) lim“#1>1 or limyja,>1, 

n=0o A n=% 


then the series is divergent. 


(() Jean le Rond d’Alembert (1717-1783), a famous French 
mathematician and encyclopaedist. 
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If the first of the inequalities (18) holds, then for 
sufficiently large n we have 


An+1 


> 1, i.e. On+1 > An o] 
ay 


whence the sequence {a,} does not converge to 0 and 
consequently, the series a,+a,+... is divergent. If the 
second of the inequalities (18) holds, then for sufficiently 
large n we have Yan >l, ie. a,>1 and the sequence 
{an} is not convergent to 0, neither. 
Remark. It may happen that 

lim ËH = 1 = lim Yan. 

N00 N n=% 
In this case our criteria do not determine whether the 
given series is convergent or divergent. Then we are 
dealing with the so called “doubtful” case; we say also 
that the series does not react to the above criteria. 


3.5. Applications and examples 


1. The series e ni? where c > 0, is convergent. 


n= 1 


Indeed, 
n+l i 
Si ee oe “lin “oO. 
An en (n+1)! n+l n=co On 


By d’Alembert criterion we conclude that the given 
series is convergent. . 


~ want, 
2. The series » zr $8 convergent. 
n=1 


n! n” 1 
Let a, = . Hence ®t! n +1)————— = : 
ae m or” Gy 
n 
Thus 
li On+1 = 1 a—, 1 < 1 


3. INFINITE SERIES 65 


n i 
3. lim $ = 0 = lim. 
N=00 ni næ n” 
This merely states that the general term a, of a con- 


vergent series converges to 0. 


Defining a sequence {an} divergent to co to tend more 
rapidly to oo than a sequence {b,} if the condition 


lim — =0 holds, we may rewrite Formula 3 in the 


T= OO 


following way: n! tends more rapidly to co than e”, and n” 
tends more rapidly to oo than the factorial n!. 


4. The harmonic series 1+ 5g He HiH does not 
react to the d’Alembert criterion. The same holds for the 
series (14). 

For, 


As we know, the first of the above two series is di- 
vergent and the second one is convergent. 
5. The series J eee) RED) op is convergent 
n=1 . 
for 0<e<l. 


For, we have for non-negative and non-integer x 


a 
Hence lim 1# = 


nee n 
The convergence of this series implies 


6. lim a(æ— i1)... (£x—n-+1) a 


nies n! 


C. 


= 0 for |e) <1. 


oo 

: nP, : 

7. The series X a convergent for c > 1 (where p is 
n=1 


. . nP 
an integer). Hence lim — = 0. 
cn 


n= 
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For, lim | 


n=00 


n+l\P œ 1 
=) peop 

8. The divergence of the harmonic series and the 
Cauchy criterion imply immediately the formula 
lim yn == 1, 
Tx 00 

n 

Since the sequence Yn is decreasing for sufficiently 

large n and consists of terms > 1, so lim Vn > 1 exists. 


Næ 


Supposing lim Yn > 1 we should get lim V 1jn<1 and 
n=00 n=00 
the Cauchy criterion would imply the convergence of 


S1 

the series > =. 
Remark *. The Cauchy criterion is stronger than the 
d'Alembert criterion. For the existence of the limit 


lim 22+! implies the existence of the limit lim Van (and 


N= CO an, Tw CO 

both these limits are equal one to another, cf. § 2.11, 4). 
However, the last limit may exist although the first one 
does not exist. 


3.6. Other convergence criteria 


KUMMER THEOREM (1), A necessary and sufficient con- 
dition for the convergence of the series a,+a.+... with 
positive terms is that a sequence of positive numbers b,, bz, ... 
exists such that 


a 
= bns) >0. 
n+ 


(19) lim (bn 
Namco 

In order to prove the necessity of the condition for- 

mulated in the theorem let us assume the convergence 


' : s—s 
of our series and let us write b, = E 


, where s is the 


n 


0) Ernst Kummer, a famous German mathematician of 19th 
century (1810-1893), an eminent worker in theory of numbers. 
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sum of the series and s, is its n-th partial sum. Then 


a. s—s. 8—8 a 
bo Be aE ee hs 


as re 
+1 
An+1 On+1 On+1 Anta 


Thus, the condition (19) is satisfied. 

Now, we shall prove the sufficiency of this condition. 
For this purpose let us assume that the inequality (19) 
holds. Then there exist an h>0 and an index k such 
that the inequality 


a 
bn-—— 


Anti 
holds for n > k. 


Thus we have 
h- Opn < bp Op — Dp k41, 
he Oye < bk}1 0k41 — Depo Ose » 


h: An < bn—1On—1—— Dn Gy . 


Adding these inequalities we obtain 
br Oy 


h(8n— Sk) < bya, — bnan < bya, , whence Bn < 8% +. 


The last inequality proves that the series a,+a,+-... 
is bounded. Hence this series is convergent, since it is 
a bounded series with positive terms. 

As a corollary from Kummer theorem we obtain 
the following 

RAABE CRITERION. A series a,+4,+... with positive 
terms satisfying the condition 


(20) lim nf = -1| >1 


n=œ \An+t 
is convergent. 
Indeed, let us write b, = n. We have to prove that 
the condition (20) implies (19). Now, 


lim (bn an ~ Pn) = lim (n as -n-1) 


m=O On+1 n= n+l 


= lim n ( On -1)-1>0. 


Nx 00 n+l 
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3.7. Absolutely convergent series 


A series a,+a,+... is called absolutely convergent, if 
the series |a,|-+|a.|-+... is convergent. A convergent series 
which is not absolutely convergent is called conditionally 
convergent. 

1. If a series a,+0,+... is absolutely convergent, then 
it is convergent in the usual sense. 

Moreover, 


(21) |5 an 


According to the Cauchy theorem one has to estimate 
the expression ap + ak1 +- +4an. Now, 


oo 
[ae + ar41 ten + an| < |ar| + lars] t+. + lan! < X fay! 
i=k 
and the last sum tends to 0 as k tends to oo, as a rest 
Tk—ı of a convergent series (cf. § 3.1). Hence for any £> 0 
there is a k such that ry. < £, whence |a,+@k41+... + a,| 
<e for any n> k. 

Thus, the convergence of the series a,+a,+... is 
proved. At the same time, writing Sn = a, + @ +... -+ an 
and t, = |a| + la| +... + lanl}, we have isa! < tn, and in the 
limit we obtain |lims,| = lim|s,| < limi, i.e. the for- 
mula (21). 

EXAMPLES. The geometric series a + aq + ag? + ..., where 
lq} < 1, is absolutely convergent because the series |a] -+ 
+[aqg!+lae|+... is convergent (cf. § 3.1). 

oO 

The series 5 z is absolutely convergent for every x 
(cf. § 3.5, 1; as we shall show later, its sum is equal to e7). 

The anharmonic series (7) is conditionally convergent, 
since the series of absolute values of its components is 
divergent (it is the harmonic series, cf. § 3.2 above). 

Now, we shall consider the problem of the commu- 
tativity of infinite series. As it is well known a sum of 
a finite number of terms is commutative, i.e. does not 
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depend on the arrangement of the terms. We shall show 
that this property remains true also for absolutely con- 
vergent series; yet it does not hold for conditionally 
convergent series. However, this requires that we first 
establish what will be understood by a rearrangement 
of the terms, when the number of these terms is infinite 
(taking into account that some terms may be repeated 
arbitrarily often). 

By a permutation of the sequence of positive in- 
tegers we understand a sequence of positive integers 
Mis ™M,,..., such that every positive integer appears in 
this sequence exactly once. If m,, Mma, ... is a permutation 
of the sequence of positive integers, then we say that 
the series @y,+4m,+...+4m,+... is obtained from the 
series @,+a,+...t+@,+... by a rearrangement of its com- 
ponents. 


2. Every absolutely convergent series is commutative. 
oo 


In other words, if a series >) a, is absolutely con- 
n=1 


vergent and if m,, m2, ... is a permutation of the sequence 
of positive integers, then 


oo oo 


(22) D, Ging =D) On 


nel n=l 


Let «> 0. The series |a] +]a,| +... being convergent, 
there exists a k such that 


(23) Ò lal <e- 


i=k+1 


Since the sequence {m,} contains all positive integers, 
a number r exists such that the numbers 1, 2,3,..., k 
all appear among the numbers Mi, Mz, ..., Mp. But each 
positive integer appears in the sequence {m,} only once; 
therefore we have M, > k for each n >r. So by a given 
n >r, if we cancel the numbers 1, 2,..., k in the system 
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Mis Mo, ++) Mr, ey Mn, then there remain in this system 
only numbers > k (and different one from another). Thus, 
writing Sn = @,+4,+...+@, and ty = am, + am + -+ Om, 
and reducing in the difference tz—s, the terms with 
equal indices, we obtain as remaining terms only terms 
with indices > k. This (and the formula for the absolute 
value of a sum) implies 


\tn—8n| < y |a;|, whence |t,—8|<« by (23). 
tok+1 


Since the last inequality holds for each n > 7, we obtain 


lim ft, = lim sn. 
N00 N=00 
This is equivalent to the formula (22). 

Remark. The previous theorem cannot be extended 
to arbitrary convergent series. For example let us rear- 
range the terms of the series 1—}$+4—}+... in the 
following way: 


1 1 
(4) 1-54+(34+5+-+ 5 —q)- G+ 


1 1 1 1 
+ ae 2, +3" wot aa) g aT 


where the numbers k, ka, ... are chosen in such a way that 


Fgh ts a> 


1 1 1 
oh, +1" ge a 


Then it is easily seen that the series (24) is divergent 
to œ. 

Writing ¢ = 1—4 + $4... (as known, ¢ = log2) one may 
easily prove that 


go=e+tteo=1+4—$+4tH—-ttitn—tt.. 


Hence we see that by a rearrangement of terms we 
may obtain from the anharmonic series a divergent 
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series or a series convergent to another limit. The follow- 
ing general theorem (due to Riemann (1)}) holds: given 
a conditionally convergent series, we may obtain a divergent 
series or a series convergent to a previously assigned number 
(finite or infinite) by a rearrangement of the terms of the 
given series. 


3.8. Multiplication of series 


oo 
(CAUCHY) THEOREM. Assuming the series > a, and 
n=1 


Me 


bn to be absolutely convergent, we have 


n 


1 


Loe] oo oo 
(25) D>, an Y bn = > ony 


n=1 n=1 n=1 
where 
c = ab, 
Cy = A,b,+ a,b, 
(26), Abe bis eA ah ee aoe ae a ey 


eo © © © © © © © © © © © © © © we ew ewe lle 


(i.e. the sum of the indices of each term in the n-th 
line equais n +1). 
Let us write Sn =@,+...t+@,, ty =6,+...+b,, and 
Un = CO, +... + Cn, ie. 
Un = Aytn + Agln—1 + Agino +... + ant. 
We have to estimate the difference 
(27) Snty— Un = Aly F aatn +... + antn — Un 
ma Ae ty — tn—1)+ 3{tn — tn—2) + eee F An(tn — ti) . 


co oO 


Since the series >») ba and J |a,| are convergent and 
=1 


n=1 


() Bernhard Riemann (1826-1866), famous for his works in the 
field of geometry, the theory of analytic functions and the theory of 
numbers. 
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consequently bounded, a number M exists such that 
(28) lt}}< MW and ja,|+jaj+...+]a)< mM 
for each j. 

At the same time, given «> 0, there exists a k such 


that the condition n > m> k implies (cf. § 2.7, Re- 
mark (8)): 


(29) |th—tmi<e and — laggi|+laxge/+...+]an|<e. 


In the following suppose that n > 2k. Then we have, 
by (27), 


Satna — Un| s< (|a.| - [tn — tn—1| “Pees + larl . Jtn — tn—=x+1]) + 


+ (Jar+1; |in tn-x! + -+ lanl [in— tl). 


Applying to the first bracket formula (29) and to the 
second one formula (28) we obtain (taking into account 
that n—k+1 > k and that |t,—t;; < |ta|+|t;| < 2M): 


|Sntn— ùn! x []a.|+.. +] apl ]e + Elakya] +- -+ [anl]: 2M 
< Me+e-2M, 


where the second inequality is a consequence of the 
second parts of the formulae (28) and (29). 

So we have proved that the inequality |8,t,—un|< 3Me 
holds for each n > 2k. This means that lim(8,t,—u,z) = 0. 
Since the sequences {sn} and {tn} are convergent, we have 
lims,t, = lims,-limt,, whence we obtain lims, limt, = 
= lims,t, = limun, i.e. the formula (25). 

EXAMPLE. We shall prove that 
ve y” sy (£ +y)” 

n! 


pa = an! 
n=0 nad n=0 


oo 


Since both series are absolutely convergent, we may 
apply the formula (25). We obtain 


Saale 
n! n! 
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_ NU y” x gt q? y”? g» i 
= atta a a aa a 


aua 1) 


1 
= \ Alri n= PYTA.. +24) 


by the Newton binomial formula. 
Let us add that the above-proved formula follows 
also from the equality e+” = e.e (cf. § 3.7) 
Remarks. The theorem is also true under a weaker 
assumption; namely, both series have to be convergent and 
one of them (but not necessarily both) has to be absolutely 
convergent. Indeed, only the absolute convergence of the 


series x a, was employed in our proof. 

Yet if both series are conditionally convergent, then 
the series x Cn may be divergent. This may be shown 
on the flowing example: 


oo oo 
the series > a, and » b, are convergent, but it is easily 
n=1 n=} 


seen that the series 5 ¢, is divergent. 


nel 
Let us add (without proof) that if both series are 
conditionally convergent, then their product may be ob- 
tained by summation of the series J c, by the method 
n=1 
of the “first means”; more exactly, the following theorem 
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(due to Cesaro) holds: if the series a, +a, +... and b, +b, +... 
are convergent, then 


oo 
; a 
lim sı +8 eee tSn N An Vo bn, 
Fae n T hamd 
n=1 n=l 


where Sn = C+ Cat -+H ên. 


3.9*. Infinite products 

Just as we consider an infinite series to be a gener- 
alization of the idea of addition to an infinite number 
of terms, we may consider an infinite product as another 
infinite operation. Here we shall restrict ourselves to 
give the definition and several more important properties 
of infinite products. 

Let an infinite sequence of real numbers different 


from 0 be given: a,, az, ..., An, --. Let us form the sequence 
of products: 
(30) Pı = Gy, Po = Ar: Moy oe, Pn = M’ Agee Angy o 


If the sequence (30) is convergent, then we denote 
its limit by the symbol 


and we call it an infinite product. If this limit is finite 
and different from 0, then we say that the considered 
infinite product is convergent. 

We call the numbers 4), a.,..., the factors of the in- 
finite product a,-a,:... The terms of the sequence (30) 
are called the partial products. 

EXAMPLES. («) The infinite product 


(1+4)-(1—4)-(1+4)-(-4)-... 
is convergent to 1. Indeed, 


2,143 an 2n-i_, 
Pen =7'9°3°4°°"'On—-1 In? 
2n+2 2n +2 


Ponti =P n onpi mti’ 
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Thus lim pr = 1. 


n= 


oo 
(8) TI (1+ z) = oo, i.e. the considered infinite product 
n=1 


is divergent to oo, for 


Pa= Fg Smt, whence lim pa = œ. 


2 n=O 
1 . eee P 
1— a 0, i.e. the infinite product is diver- 


gent to 0, for pp ==. 


(è) The infinite product (—1)-(—1)-... is divergent. 
Moreover, it is divergent neither to 0 nor to oo. In this 
case the sequence of partial products oscillates, taking 
the values —1 and +1, alternately. 


1. CAUCHY CONDITION. A necessary and sufficient con- 
dition for the convergence of an infinite product a, az... 
(where a, # 0) is that to every £ > 0 a number k exists such 
that the inequality 


(31) | Qe- Ongr: -t An—1| <E 
holds for each n> k. 


To prove the necessity of the Cauchy condition let us 
assume that the considered infinite product is convergent, 
i.e. that 


(32) lim Pm = p #0. 
m= 


Let c = ł|p|. Then a number j exists such that 
|Pm| >c for m>j. 

Let a number £> 0 be given. By (32), there exists 
a k such that |p,—p.-1|< ce for n> k. One may also 
assume that k—1 > j, and so |pxz-1| > c. Hence we obtain 
Pe —1| wees < E ; 
Pr- |Pr-1| 
i.e. the inequality (31). 
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In this way we have proved that the Cauchy con- 
dition is a necessary condition for the convergence of the 
infinite product under consideration. Now, we shall prove 
the sufficiency of this condition. 

Let us assume this condition to be satisfied. First of 
all we shall prove the sequence {pa} to be bounded. 
Substituting « = 1 in the Cauchy condition we conclude 
that a number r exists such that for n >r we have 


|Qr41° ar42 Qn—1| < 1, i.e. 


aan | <1; 
Pr 
thus |pn—Pr|<|pr|, whence |pn|—|Pr| <|Pn—Prl < | pr 
and finally |Pa| < 2|p,|. Hence we conclude that the 
sequence (30) is bounded. 

Now, let M be a number satisfying the condition 
M >|p,| for each positive integer n. According to (31), 
to any given number £> 0 there exists a k such that 


(33) 


eee | | <E 
Pk-ı 
for n >k. Hence |pan— Pr-ı| < e|Px-ı| < eM. Thus, the 
sequence {p,} is convergent. It remains to prove that 
its limit is Æ 0. 

Now, supposing lim p, = 0, the formula (33) (with 

naco 

a constant k) should give the inequality 1 <e which 


contradicts the assumption that € is an arbitrary positive 
number. 


2. If the infinite product a,-a,-... is convergent, then 
lima, =1. 
Nw 


Namely, let us assume that lim p, = p # 0. Then we 
have lim pn—ı = p and dividing the first equality by the 


N=C0O 
second one we obtain 
lim Pn 
lim a, = lim —* = #2 =] 
n=% n=% Pn-1 lim Pn—1 
N= 
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Let us note that the equation lim a, = 1 being (as we 


n=200 


have proved) a necessary condition of the convergence 


of the product |] an, is not a sufficient condition. The 
nml 


examples (6) and (y) show this. 


Taking into account Theorem 2 it is suitable to 
write the factors of an infinite product in the form 
an = 1 +b. This makes possible a simple formulation 
of the dependence between the convergence of the product 


TT (1+ 5n) and the convergence of the series > ba. In 
n=1 n=1 
fact, the following theorem holds: 


3. Assuming b, > 0 for each n, the product [] (1+ dn) 


Nml 
wo 
is convergent if and only if the series >) b, is convergent. 
n=} 


The same concerns the product [] (1— bn) (assuming bn < 1). 
n=l 


A simple proof of this theorem may be obtained by 
application of the properties of the exponential function 
and especially of the inequality e > 1+. which we shall 
prove in § 8 (formula (16)). This inequality gives im- 
mediately 


Dn <e, where pp = (1b)... (L+ bn), 


Sn = bi. ön. 


Since on the other hand we have, as easily seen, 
1+8,<Pn, we conclude that the series {pa} and {sn} 
are either both bounded or both unbounded. Now, they 
are both increasing sequences; hence they are either both 
convergent or both divergent. Finally, the sequence {pn} 
cannot be convergent to 0, because p, > 1. 


Thus, the first part of our theorem is proved. 
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Before we proceed to the proof of the second part, 


let us note that if the product |] (1 + |Un|) is convergent, 
n=] 


© 
then the product [I (1+un) is convergent, too. 
n=l 
For let an e> 0 be given and let k be chosen (ac- 


cording to Theorem 1) in such way that 
(1+ juel) (L+ l] engi): (1+ lun) —1<e for n>k. 
Since, as is easily seen, 

[(1 + ur): wees (L+ un) 1] < (1+ url) e (1 Hlal), 


so Theorem 1 implies the convergence of the product 
co 


IT (1+ Un). 


n=] 


oO 
Now, let us assume the series » b, to be convergent. 
n=1 


By the first part of our theorem the product i (1+),) 
is also convergent and thus, by the just proved Temarks, 
the product IT (1—5,) is convergent, too. 

There remains to prove that the convergence of the 


co 

product |] (1—b,) implies the convergence of the series 

n=l 
» bn. Let ga = (1— b1): ...- (1— bn) and let lim gq, = q> 0. 
n=l N00 
Since q Sqn SET, ie e< z the sequence {Sn} is 
bounded and so it is convergent. 

oo 


An infinite product i (1+4uUn) is called absolutely con- 


vergent, when the product I (1+ |u,|) is convergent. As 


we have just proved the “absolute convergence implies 
convergence in the usual sense. One may also prove 
that—just as in the case of the series—the value of an 
absolutely convergent product does not depend on the ar- 
rangement of the factors. 
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Exercises on § 3 


1. Prove the associativity law for convergent infinite 
series. Give an example of a divergent series a, + a; + 43+... 
such that the series (a, + a) + (a3 +4a,) +... is convergent. 
2"n! 

nr 


2. Prove that the series > 


n=1 


is convergent and the 


S 3n! 
series J jn is divergent. 


n=1 

3. Give an example of an alternating divergent series 
with the general term tending to 0. 

4. Give an example of a convergent series a,+a,+... 

On+1 


with positive term for which lim does not exist. 


Ne OO Tr 
5. Prove that if a series a,+a,+... with positive de- 
creasing terms is convergent, then lim na, = 0. 


nN=0o 
~ 1 
6. Prove that the series = is convergent for s>1 
n=1 
and divergent for s <1. 
Hint: apply the Raabe criterion. 


7. Prove that if a series a,+a,+... with positive 
terms is convergent, then the following two series are 
also convergent 

fee) 


oo 
ye k 

ae and V Oni1* An42-' -© ntk - 
n=1 


n=l 


8. Prove that the convergence of the series a,+ 4,4... 
with positive decreasing terms implies the convergence of 


the series J 2”a,, (Cauchy condensation theorem). 


n=l 


9. Assuming the formulae 


; a ot 
ata and cose = l- at gyms 


SUT =i 31 
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verify the formula sin(#+y) = sinzcosy+sinycosx ap- 
plying the theorem on multiplication of series. 


10. Calculate the infinite products 


co co 
1 1 
Ü e-e Da 
ii (n+1)? it n(n-+ 2) 
11. Examine the convergence of the product 


ia +a”). 


CHAPTER II 


FUNCTIONS 


§ 4. FUNCTIONS AND THEIR LIMITS 


4.1. Definitions 


If to any real number x there corresponds a certain 
number y = f(x), then we say that a function f is de- 
fined over the set of real numbers. 

For example by associating with any number v its 
square y= a we have defined the function f(x) = æ. 
Similarly, the equation y = sinw defines a function over 
the set of real numbers. 

Not every function is defined over the whole set of 
real numbers; e.g. the equation y = 1/æ defines a func- 
tion over the whole set of real numbers except the num- 
ber 0; because this equation does not associate any number 
with the number 0. Similarly, the function fz is defined 
only for r>0; the function tanv is defined for all real 
numbers different from odd multiples of the number $r. 


Generally, if to any x belonging to a certain set there 
corresponds a number y = f(x), then a function is defined 
over this set. This set is called the set of arguments of 
the function. The numbers y of the form y = f(x) are 
called values of the function f; e.g. for the function /z, 
the set of arguments equals the set of numbers > 0 and 
so does the set of values of this function (by the way, 
let us add that the symbol +yz does not define a func- 
tion, since it is not unique; by our definition, a function 
is always unique). 

We shall often speak about functions defined over an 
interval with ends a and 6. Here we shall distinguish 
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between the closed interval, i.e. interval together with 
ends that is the set of x satisfying the condition a < æ < b 
and the open interval, i.e. interval without ends, that is 
the set of x such that a <æ < b. 

Geometrically, we interpret a function f as the set 
of points on the plane ot the form (x,y), where y = f(x). 
This set is called the graph 
of the function f (or the 
geometric interpretation of 
the function f, or the curve 
y =f(x)); e.g. the graph 
of the function æ? is, as 
well known, the parabola 
and the graph of the fun- 
ction 1/z, the hyperbola 
(cf. Fig. 2). 

Projecting the graph of 
a function on the z-axis we 

Fig. 2 obtain the set of arguments 

of the function. Projecting 

it on the y-axis we obtain the set of values of the function. 
Among the sets lying on the plane, the graphs of func- 
tions are characterized by the property that no straight 
line parallel to the y-axis contains two points of the set. 

Let us add that by our definition a function having 
the set of all positive integers as the set of arguments 
is an infinite sequence. 

In all applications of mathematics, investigating re- 
lations between certain quantities, we are dealing with 
functions. E. g. the distance s covered by a body moving 
with a constant velocity v in a time ¢ is given by the 
formula s = vt; similarly, the distance covered by a body 
falling under the gravitation field of the earth is a func- 
tion of time, namely s = łgť. 

The variable x in the expression y = f(x) will be 
called also the independent variable, and y will be called 
the dependent variable. However, it has to be remembered 
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that the constant function y = ¢ (we write also y = con- 
stant) will be also reckoned among functions; its graph 
is a straight line parallel to the z-axis (or identical to 
the x-axis). 

The functions about which we have spoken above are 
functions of one variable in distinction to functions of 
two and more variables. By a function of one variable, 
a number corresponds to any real number (belonging to 
the set of arguments), by a function of two variables, 
the value f(x, y) corresponds to the values of an ordered 
pair æ, y. Similarly, by a function of three variables, 
a certain number f(x, y, 2) corresponds to any triple of 
real numbers. 


4.2. Monotone functions 

If the condition «< x’ implies f(x) < f(x’), then the 
function f is said to be strictly increasing. If in the last 
inequality the sign < will be replaced by <, then we 
are dealing with a function increasing in the wider sense 
(i.e. with a non-decreasing function). Similarly, if the 
condition x < x’ implies f(x) > f(x’) or f(x) > f(z’), then 
the function is said to be strictly decreasing or decreasing 
in the wider sense (non-increasing), respectively. 

Increasing and decreasing functions (in narrower or 
wider sense) are embraced by the general name monotone 
Junctions. 

EXAMPLES. The function æ? is strictly increasing. The 
function æ? is decreasing on the half-straight line æ < 0 
and increasing on the half-straight line v > 0, on the 
whole X-axis it is neither increasing nor decreasing. 

An example of a function increasing in the wider 
sense (but not strictly increasing) is the function [x]. By 
this symbol we indicate the integer n satisfying the 
inequality n <a (see Fig. 3). 

The function sing is “piecewise monotone”: it is in- 


creasing in the interval 5 <r decreasing in the 


T 
2? 
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interval 5 eS etc. The functions cosg, tanv possess 
a similar property (as do most functions which we meet 
in practice). 

Let us note here that the above mentioned trigono- 
metric functions have an important property of periodi- 


Fig. 3 


city. A function f(x) is called periodic if a number c 
exists (called the period of the function) such that the 
equation f(x) =f(#+c) holds for every value x. The 
function sin has a period 27, the function tan has a period r. 
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Remark. In general, a function f(x) will be called 
piecewise monotone in the interval a < x < b, if the interval 
a<2<b may be divided by means of a finite system of 
points 


A<a<ag<..<a,, where a,=a and an =b 


in intervals a 4,, 4,42, ...) @,-14 in such a way that the 
function f(x) is defined and monotone inside of each of 
these intervals. 

For example the function defined by the conditions: 
f(x) = xforO0<2r<1,f(1) =3,f(x) = &—i fori <v < 2, 
is piecewise monotone in the interval 0 <æ <2. 


4.3. One-to-one functions. Inverse functions 

If the function f is strictly increasing, then the equa- 
tion y = f(x) determines x as a function of y, i.e. this 
equation may be solved with respect to x (treated as 
an unknown). Indeed, since to different x there cor- 
respond different y, so to any y belonging to the set of 
values of the function f there corresponds one and only 
one x such that f(x) = y; hence x is a function of y. 
Thus, denoting this function by g we see that the equations 


(1) y=f(v) and «r= g(y) 


are equivalent one to another. The function g is called 
inverse to f (sometimes we indicate it by the symbol f-}). 

If we should assume the function f to be strictly de- 
creasing instead of assuming f to be strictly increasing, 
then we should find that f has an inverse function by 
the same arguments as above. For, the existence of the 
inverse function takes place always when the given func- 
tion is one-to-one, ie. when the condition x 4 x’ im- 
plies f(x) 4 f(z’). 

EXAMPLES. The function y = 24+3 has an inverse 
function, since solving this equation with respect to x 

y¥—3 


we obtain x =, 
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The function z? considered on the whole X-axis is not 
one-to-one because g? = (—2x)*. However, if we restrict 
the set of arguments to the half-straight line x > 0, then 
the function « is one-to-one in this set and its inverse 
function is Ya. Similarly, restricting the arguments to 
the negative half-axis we should get — px as the inverse 
function. Thus, although the function æ? considered on 
the whole X-axis does not possess an inversion, it may 
be spoken about various “branches” of the inversion of 
this function (after suitable restricting of the set of its 
arguments). 

Geometrically, a graph of a one-to-one function is 
characterized by the fact that on no straight line 
parallel to the X-axis does it contain two different points. 
According to the characterization of graphs of functions 
given in § 4.1 it is the graph of the function æ = q(y). 
To get from this function the function determined by 
the equation y = g(x), a rotation of the graph around 
the straight line y = x as the axis has to be performed. 

Let us note the easily proved formulae 


(2) gifa] =x, figa) =y. 


4.4. Elementary functions 


A function of the form ax+b, where a and b are 
constants, is called a linear function. The geometric graph 
oi a linear function is a straight line. Conversely, any 
straight line, except straight lines parallel to the Y-axis, 
is a graph of a certain linear function. Depending on the 
sign of the coefficient a the function ax +b is increasing 
(for a> 0) or decreasing (for a < 0); if a = 0, then the 
function has a constant value b. Hence our function 


: —b 
possesses an inverse 7 = =, when a 40. 


The next (in consideration of the simplicity) class of 
functions is the class of functions of the second degree: 
az? + ba +c. Geometrically they represent parabolae (when 
a +0). A more general class of functions represent the 
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polynomials, i.e. functions of the form ags” + aa” +... + 
+n—12+4,. A further generalization consists of the 


rational functions, i.e. functions of the form 


where P(x) and Q(x) are polynomials. 

Polynomials are defined for all values of xv. Rational 
functions are defined for all æ except values for which 
the denominator vanishes, i.e. except the roots of the 
equation Q(x) = 0. In the domain of rational functions 
the four arithmetical operations: addition, subtraction, 
multiplication and division are performable; in the domain 
of polynomials, the first three operations only. 


The function inverse to the power x” is the root Vo. 
If n is odd, then this function is defined for all x and 
if n is even, then it is defined only for x > 0. 

The roots are powers of the form Y”. More generally, 
we consider powers <° with an arbitrary real exponent for 
æ > 0. This function is increasing if a > 0 and decreasing 
if a < 0 (for a= 0 it is a constant) (cf. Fig. 2). 


Especially, the rational function 1 represents geo- 


metrically a rectangular hyperbola. 

Treating the exponent in the power as a variable 
and the base as a constant, we get the exponential function 
a7; we assume a> 0. The exponential function is in- 
creasing for a œ> 1 and decreasing for a< 1. 

The function inverse to the exponential function is 
the logarithm: the conditions y = logax and x = aY are 
equivalent (for 0 < a =Æ 1). 

In particular, the function inverse to y = e, where 


e= tim(1 +7)" (cf. §2.10), is the natural logarithm x = logy 


(which we write without indicating the base). 

The logarithmic curves y = loggx are obtained by 
rotation of the exponential curves y = a? around the 
straight line y = 2. 

Among the elementary functions we include also the 
trigonometric functions sing, cosx, tana and the functions 
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inverse to the trigonometric functions (i.e. cyclometric 
functions): arcsing, arccosy, arctang. Since the trigo- 
nometric functions are not one-to-one, in the inversion 


log x 


Fic. 5 


of these functions we have to restrict the arguments to 
a suitable interval. We take —ixn<a2< łvr for sing, 
0<a<x for cosz, —ġn <x < $x for tanz. In each of 


Fic. 6 


these intervals the functions considered are one-to-one 
and so reversible, respectively. It is clear that one could 
take other intervals for the argument; we should get 
other branches of the inverse functions. 
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Let us note that the set of arguments of the functions 
arcsing and arccosg is the interval —1 <x < 1 and the 
set of arguments of arctan is the whole X-axis. 


Remark. In elementary courses, the method of intro- 
duction of the power a? with a real irrational exponent 
is usually based implicitly on the existence of the limit 


lim a’, where {r,} is a monotone sequence of rational 
N=Co 


numbers convergent to x (e.g. the sequence of decimal 
expansions of the number g). Now, the existence of this 
limit follows from the theorem on the convergence of 
monotone bounded sequences (§ 2.6, Theorem 3) and 
from the theorem on the monotony of the function a” for 
rational r, known from the elementary algebra. 

The equation a? = lim a™ (a > 0) is considered as the 


N==00 
definition of the power for irrational exponents. Here it 
makes no difference which sequence of rational numbers 
convergent to r will be denoted by {7,}, for lim r = lim rẹ, 


n=O n= oO 


implies lim q’ntn — J (ef. § 2.9, (%)), whence 


n=% 


tA + 
lim a™ = lim a™. lim a ™" = lim a™., 


n=00 n=% n= n=O 


The following formulae known for rational exponents 
from the elementary algebra hold also for arbitrary real 
exponents (when a> 0): 


(3) a **=a"-a", (abf =a" b, (aY =a”. 


Writing « = lim ra, y = lim s, and applying the above 
nN=00 n=% 


formulae to the rational exponents 7, and s, we perform 
the proof by passing to the limit. 


4.5. The limit of a function f at a point a 


The number g is called the limit of a function f at 
a point a, if for every sequence {x,} convergent to a with 
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terms different than a the equation lim f(xz,) = g holds; 


N=0O 


we denote this fact symbolically by 
lim f(£) =g. 
r=a 


Thus, there exists the limit of the function f at 
a point a, if a common limit of all sequences f(x), f(a), ... 
such that 


limz,=-a and «4a for each n 


N==00 

exists. 

For example lima?=0, for if lima, =0, then 

z=0 N=00 

. 2 : ° 
lim z, = (lim z,)? = 
n=O N=00 

limeosz = 1. Indeed, 1—cosx = 2sin?4a and since 


x=0 
by a known formula |sint| < |t|, we obtain |1—cosa| < 42°, 
whence lim(1—cos#) = 0, i.e. limcosa = 1. 


z=0 x=0 
It is also easily proved that 
(4) lima? =1 (a>0). 
z=0 


If a function f is defined not for all real numbers, 
then we assume 2, to belong to the arguments of this 
function; yet we do not assume this on a (assuming only 
that a is the limit of a certain sequence of arguments 
different than a); e.g. the function = is not defined 


for x = 0, however, there exists the limit of this function 
at the point 0, namely, 


(5) iim = 7. 


Indeed, we have 
(6) sing < g < tang 
x 
2 
inequalities is obtained by multiplication of the second 


for = > #> 0 and thus cos < m < 1 (the first of these 
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inequality (6) by — and the second one is obtained 


by division of the first from the inequalities (6) by <æ) 
Since limcosx = 1, so we easily conclude that lim z, = 0 


xr=0 N=00 


and 2%, > 0 imply lim f (tn) =1 (cf. -§ 2, (17)). Finally, 


the assumption x > 0 may be replaced by x < 0, because 
sin(—#) sing 

2y z` 

The symbol limf(x) will be used also to indicate the 


tsa 


improper limit; e.g. lim% = = œ. Yet limt does not exist, 
x=0 Ù r= 


: | : 
since we have lim en for sequences {2n} tending to 0 
n= Vn 


through positive values and lim — = —oo for sequences 
N=WOYN 
with negative terms, respectively. 

However, in this case we can speak about a one-side 
limit at the point 0. Namely, a number g is called the 
right-side (or left-side) limit of a function f at the point a, 
if the conditions lim z, = a and a, > a (or a, < a) imply 


n=% 


lim f (za) = g. The symbols 
n=% 
lim f(v)- and lim f(x) 


zr=a+0 xr=a—0 
(denoted also by f(a+0) and f(a—90)) indicate the right- 
and the left-side limit of the function f at the point a, 
respectively. 


. 1 1 er 
Then we have lim == œ, lim =- = —oo. Similarly, 
rator ga ot 
lim logsz = —oo, lim tang = œ, lim tang = — oœ, 
gz=+0 4 n 
r= —0 z=- 4+0 
m z2 2 
(7) 


lim [z] =w—-1. 
can—O 


However, there exist functions which do not even 
possess one-side limits (neither proper, nor improper). 
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Such is the function 


(8) jlx) = sin} (a0): 


It has no one-side limit at the point 0. Indeed, sin 
has the value 1 at the points $7, $x+2z2, n+ 4n,..., 
2 
(4n+1)x’ 
lim f{(%,) = 1 and lim x, = 0. At the same time, writing 


n=O n=00 
2 
l oaa li n) = 1 lim 2, = 0. 
Xn (ivan we have a f(x) and. ie x, 

Thus, no right-side limit of the function f at the point 0 
exists; similarly, there exists no left-side limit at this 


point, too. 


tn+2nr,... and so writing 2, = we have 


Fie. 7 


Another example of a singular function constitutes 
the function assuming the value 1 at rational points 
and the value 0 at irrational points (so-called Lejeune- 
Dirichlet (1) function). It does not possess either of the 
one-side limits at any point. 

Besides the limit of a function at a finite point a, 
the limit at infinity is considered, too. Namely, we denote 


(1) Peter Lejeune-Dirichlet (1805-1859), a famous German ma- 
thematician. 
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by lim f(x) the common limit of the sequences f (x1), f (£a); ... 


gaw 


such that lima, = oo (if such common limit exists). 


n=00 


For example we have 
(9) limt =o, lim e = œ = limlogr, lim e=0. 
z=% V t= @=00 Zm —oo 


The trigonometric functions sin, cos, tan do not possess 
any limit at + oo. 


4.6. Operations on the limit 


Assuming the existence (and finiteness) of the limits 
limf(z) and limg(#), we obtain the formulae: 
Tma 


zT=q 


(10) lim[f (x) + g(«)] = tim j (2) + lim g(x) ’ 
(11) lim [f(a) — g(s)] = Lima f (a2) — lim g(x) ’ 
(12) am (o) gle) = im j{ 2): Migla 

ia IO) 
(13) lim a) = E , when limg(2) #0. 


The above formulae remain true if a is replaced by oo 
or —oo. They remain also true for one-side limits. 

These formulae are consequences of suitable formulae 
for infinite sequences (§ 2, (6)-(9)). For example we shall 
prove the formula (13). 

Let lim/(x) = A, ee A ae B + 0 and let tim a= : 


tr 
where 2, es a. Then we > have an f(n) = A, mm Gaa) = 


Hence we conclude from the “formula for. the quotient 
of limits (§ 2, (9)) that 
lim f(x 
lim Í (£n) es a 
n=00 J (Ln) lim g(2n) ’ 
n=0 


which implies formula (13). 
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Similarly we conclude from formulae (15) and (17) 
§2 that, if the limits limf(x) and limg(zx) exist, then 
x=a r= 


(14) the inequality f(x) < g(x) implies limf(x) <limg(zr), 


r=a zt=a 
(15) the inequality f(x) < h(x) < g(x) together with limf (x) 
@L=a 


= limg(zx) imply limh(x) = limf (x) = limg(a). 


Here the formulae are valid for a = -+too and for 
one-side limits. 

The following formula on the composition of func- 
tions holds: 


(16) Jf limf(x) = A and lim g(y) = B, then limg[f(z)]= B, 
z=a y=A x=a 


if the function f does not assume the value A in a neigh- 
bourhood of the point a (i.e. in a certain open interval 
containing a). 

This formula remains true also for infinite values 
A,B and for one-side limits, after accepting to write 
lim f(x) = A+0, if limf(x) = A and if f(x) > A in a neigh- 
t=O @=a 
bourhood of a (an analogous convention regards the symbol 
A—0O and the one-side limit). 

Namely, let lima, =a and xr, 4a. Then we have 


n= 


lim f(@,) = A. Let us write y, = f(#,). Since the func- 
oO 


n= 

tion f does not assume the value A in a certain interval 

containing the point a inside, so we have, for sufficiently 

large n, f(n) Æ A, ie. y, # A. Thus lim g(Yn) = B, i.e. 
n=00 


lim g[f(2n)] = B. Hence we conclude that limg[f(x)] = B. 


In particular we have the following formula which 
enables us to reduce the calculation of limits at oo to 
calculation of limits at finite points: 


(17) If lim iÈ) exists, then Tiny F(t) = tim (3). 


r=+0 
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Indeed, substituting «x =} we have lim? = +0, 


f=200 
whence we get the formula (17) according to the previous 
one (writing a = œ and A = +0). 
As is easily seen, the reverse relation also holds: 


(18) If limf(t) exists, then lim i(3) = lim f(t). 
t= z 


z -+0 t= 


EXAMPLES. (x) The following formula has an im- 
portant application in the differential calculus: 


1 
(19) lim(1 +x} =e. 
z=0 


To deduce this formula we shall consider two follow- 
ing cases: 


1) x> 0. Let us write y = = One has to prove that 
f 1\y 
(20) lim (2 + 5) =e 
y=% y 


according to the formula (18). Now, let lim y, = co and 


n= 
let us write kn = [Yn], i.e. that k, is a positive integer 
satisfying the double-inequality 


(21) kn S Yn < kn +1. 


Hence 


and thus 


1 kn+1 1 | \un 1\kn 1 
(+e) ae <à) <(1+5) E. 


oh aay 
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Since lim Yn = co and kn > y¥,—1, we have lim k, = co 


N=O 1 N=CO 
n 
and since lim (1 + z) = ¢, we conclude (cf. § 2, Exercise 5) 
n=% 
kn 
that lim ie = e. Finally, since 
n=% kn 
im—Ż—=1 = lim (1+ 5) 
N=CO 1 + 1 N=CO kn 
kn +1 
we obtain 


lim (1 cs =)” = 


according to the formula of the double-inequality 
(ef. § 2, (17)). 

So the formula (20) and thus the formula (19), too, 
are proved for x >Q. 


2) Let z < 0. Writing y = we have 


1 i 
lim (1+ x} = lim ({1— g) *= DEE eee 
ai ayia tim (1-7) 
y=% Yy 
Hence it remains to prove that 
: y 
(22) lim(1—3) al 
y=% y e 
Let lim yn = co. The formula (21) gives 


kn+1 kn+1 Yn 
kn Yn Yn 


1 Yn 1 Kn 
wep pea ey eae 
E (2 T. al = (1 i. zi) 


However, lim (1-3) + (ef, $2.10, (26)); hence 
, 1\ 1 
reasoning as before we obtain lim (1-=- mre Thus the 


formula (22) is proved. 
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(8) lm? = oo, i.e. the function e” increases more 


aiy than x. 
Namely, let lim z, = œ and let kp = [£n] as before. 


N= OO 
Thus, 


en ein ekn 
— > > d . 
TELI? IK, for &,>1 
e en 
Since (§ 3.5, 7) lim — = œ and lim k, = oo, so lim — = oo 
n=% n n=00 naco Ky 
Tn 
and thus lim — = oo. Whence the required formula follows. 
n= VN 
£ 
(y) Un zr T 
Since x = egt and lim logg = oo, so substituting y = logg 
T= 
we obtain (cf. (16)): 
log z Yy 
lim —— = lim o—— =lim© = co. 


z= Og T a logax y=% Y 


(3) lim (xloge)=0. 
z=+0 


For 


lo x 
i logt _ 4 


lim (xlogax) = lim == —lim 


Z=+0 t=00 l=% t 


4.7. Conditions for the existence of the limit 


The following theorem corresponds to the theorem 
on the convergence of monotone bounded sequences: 

THEOREM 1. Tf a function f is increasing (in the wider 
sense) and bounded above, then lim f(x) exists at every 
point a. A 

An analogous theorem holds for decreasing functions. 

By a function bounded above (or below) we understand 
a function, the set of values of which is bounded above 


98 I. FUNCTIONS 


(below), i.e. a function f such that a number M exists 
for which the inequality M > f(x) (or M < f(x)) holds 
for every x. 


The proof of Theorem 1. The sequence a= 


being increasing, the sequence l i(a—)} is increasing, too. 
But since the last sequence is also bounded, hence it is 


convergent. Let lim f a7) = g. It remains for us to 


N=CO 


prove that the conditions ima, =a and z< a imply 


n=oo 


the equation 
lim f(a) =g. 
n=% 


Let an £> 0 be given. Then there is an m such that 


9-i(«-5] <e. To this m we choose a number k such 
that the inequality n> k implies a= < Lp. Hence 


s(e-3]) < f(£n), whence 


1 
g— Í (őn) < g—1(a—<) <E. 
Moreover, to each n there exists an 7, such that 


1 
In <a——. Hence 
Tn 


fam) <t(a=>) <y, ie g— fle) >0. 


Hence we conclude that lim f(a) = g. 


TL= 00 
Remark. Theorem 1 may be generalized to the case 
of unbounded monotone functions just as to the case 
a = +o, It may be written also in the following, slightly 
more general, form: 
If a function f is monotone (in the wider sense) and 


bounded, then the limits lim f(x) exist at every point a. 
xv=a+0 
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The proof is completely analogous. 
THEOREM 2. If a funetion f has no (finite) limit at 


a point a, then a sequence {x,} exists such that m Ln = Q, 
=00 
In £ a and that the sequence {f(x,)} is divergent. 


For, let us suppose the sequence {f(z,)} to be con- 
vergent for every such sequence {£n}. Since the function f 
has no limit at the point a, so two sequences {z,} and 
{za} must exist satisfying our conditions and such 
that lim f(z,) # = f (£a). Let us consider the sequence 


n= 
Tiy biy Day boyero Ai £a, --- This sequence is convergent to a 
and all its terms are #a, but the sequence /(x,), f(x), 
f (£2), f(a), ... is divergent. 
The following theorem includes the so-called Cauchy 
definition of the limit of a function at a point: 


THEOREM 3. A necessary and sufficient condition for 
the equation limf(x) = g to be valid is that to every e>0 


z=4 

a number ô > 0 exists such that the inequality 0 < |a—a| < ô 
implies |f(x)—g| < e. 

First, let us suppose that the Cauchy condition is not 

satisfied, i.e. that there exists an ¢ > 0 such that to any 

6>0 an v exists for which 0 < |x—a| < ô, but |f(x)—g| 


>. Especially, substituting 6 =; We conclude that 


there exists a sequence {æn} for which 


(23) 0 <|a,—a| <= 
and 
It follows from (23) that lim Lu = aand La Æ a. Hence, 


supposing lim/(x) =g we should have nm f (£a) = g. But 


the last formula is contradictory to the “inequality (24). 
Thus we have proved the Cauchy condition to be 
a necessary condition for the validity of the equation 
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ama) =g. We shall now prove this condition to be 


a Saufficiens one. 
Let an e > 0 be given and let lima, = a and a 4 a. 


Then by the Cauchy condition, a number 6> 0 exists 
such that the inequality 0 < |#,—a|< 6 implies |f (æ„)—gl 


<e. But in consideration of the equation lim z, = a, the 
N=0O 


inequality j2,—a|<6 holds for all n beginning with 
a certain k. For the same n we have the inequality 
|f (£a)—g| < £. This means that lim f(x,) = g. Hence we 


conclude that lim/(#) =g. i 
T=a 
The following theorem corresponds to the Cauchy 
theorem in the theory of sequences (§ 2.7): 


THEOREM 4. A necessary and sufficient condition for 
the existence of the (finite) limit of a function f at a point a 
is that to any e>0 a number ô> 0 exists such that the 
conditions 


(25) 0<jæ—aj<ó and U<|e’-al<6 
imply |f(x)—f(x")| < e. 
Indeed, our condition is necessary, for if e =, 


then to any given e> 0 there is a 6>0 such” that the 
condition 0 < |rz—a|< Zs implies |/(x)--g] < łe. Hence, if 
the conditions (25) a satisfied, then the inequalities 
| f(zw)—g| < $e and | f(#’)—g| < ae hold. Adding both these 
inequalities we obtain Fo L| < e. 

The condition is sufficient. Tadeed; let us suppose 
that the limit of the function f at the point a does not 
exist. Then there exists by Theorem 2 a sequence {zra} 
such that lim £, = a, &n 4 a. Suppose the condition for- 


n=00 e s 
mulated in the theorem is satisfied. Since the equation 


lim 7, = a implies the existence of a k such that for 
n=% 
n >k, £= zp and z =r, may be substituted in the 


inequalities (25), so we have |f(r,)— f(r) < e. By the 
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Cauchy theorem on sequences, we conclude the conver- 
gence of the sequence {f(z,)}, in contradiction to our 
assumption. 


Remark. For a= œ Theorems 3 and 4 may be 
formulated as follows: 


THEOREM 3’. A necessary and sufficient condition for 

the equation lim f(x) = g ts that to any e>0 a number r 
T= 

exists such that the inequality x >r implies |f(x)—g|< e. 

THEOREM 4’. A necessary and sufficient condition for 
the existence of the (finite) limit lim f(x) is that to any 

n=% 

e>0 a number r exists such that the conditions £>r 
and x' >r imply |f(x)—f(x’)| <e. 

The proofs of these theorems are completely analogous 
to the proofs of Theorems 3 and 4. 


Exercises on § 4 
1. Sketch the graphs of the functions 
x . 1 ae i eee t 
7I’ x—[s], osin, sinz, 703 
and calculate the limits of these functions at the point 0. 


2. Find the limits of a polynomial at oo, i. e. 


lim (2+ ap” +... +a, +4) (consider the case of n 
@=+00 


even and the case of n odd, seperately). 


3. Evaluate: 


hang ae rai @—l 


4, Let a bounded function f(x) be given in the interval 
a<a2<b. Let us divide this interval into a finite number 
of intervals by means of the points a,<a,<...< a, 
(where a, =a, a, = b) and let us consider the sum 


s = |f(a)— f (ao)| +|f(a2)—F(a,)| +... +|f(@n) —f(an-1)) - 
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If the set of the numbers s corresponding to all possible 
partitions of the interval ab is bounded, then the func- 
tion f is said to be of bounded variation. 

Prove that the sum of two functions of bounded 
variation is a function of bounded variation; a monotone 
function is of bounded variation. 

5. Prove that if a function f bounded in each finite 
interval satisfies the condition lim [f(x +1)—f(x)] =g, 

z=% 
then ia =g. 
z=% V 


6. Prove that the formula f(x) = lim lim (cosn!xax)* 
n=% k=00 


represents the Dirichlet function considered in § 4.5. 

7. A function f(x) is called an even function, if the 
condition f(x) = f(—x#) holds for every æ. Analogously, 
if the condition f(x) = —f(—a) is satisfied, then the 
function f is called an odd function. 

Give examples of even functions and odd functions, 
among the trigonometric functions. 

Characterize even and odd functions by means of 
geometrical conditions. 

8. Prove that every function is a sum of an even 
function and an odd function. 

(Note that the function g(a) = f(x) +/(—a#) is even.) 


§ 5. CONTINUOUS FUNCTIONS 


5.1. Definition 


A function f is said to be continuous àt a point a, if 
the condition 


(1) f(a) = limf(2) 
=a 
is satisfied. 
According to the definition of the symbol lim/(z) 


z=a 
this means that the equation lima, = a implies the 


n= 
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equation lim f(z,) = f(a). (Obviously, assumption x, Æ a 
n=% 


may be omitted here.) 
Thus, if a function f is continuous at a point a, then 


(2) f(lima,) =limf(z,), whenever lima, =a. 
n=00 n=% N=CO 

If in the equation (1) we replace the limit by a one-side 

limit, we obtain the definition of the one-side continuity. 

Namely, a function f is right-side continuous (or left-side 

continuous) at a point a, if 


f(a) = lim f(@) (or f(a) = lim f(a). 
z=a+0 xr=a—0 

If a function f is defined not for all æ, then we restrict x 
obviously to the set of arguments of the function f(z); 
e.g. if the set of arguments of a function f is the closed 
interval a < æ < b, then the continuity of the function f 
at the point a means the same as its right-side continuity. 

A function continuous at every value of the argument 
is called briefly a continuous junction. In particular, 
a continuous function defined in the interval a <z <b 
is a function continuous at every point inside this interval, 
right-side continuous at a and left-side continuous at b. 

A function f will be said also to'be piecewise con- 
tinuous in the interval a <x <b, if this interval may 
be divided by means of a finite system of points a,< a, 
<a <... <an, where a) =a and a, = b, into intervals 
1%, k =1,2,...,n in such a way that the function f 
is continuous inside of each of these intervals and that 


the limits lim f({x) and lim f(x) exist; i.e. if for each k 
T=Ay +0 r=a,—0 


the function f(x) defined by the conditions f(x) = f(x) 
for ay—1<a@ <a, and fx(ag—1) = f (akı +9), felak) = f (ar — 0), 
is continuous. in the interval ap- <S £ S ax. 

Thus, a function having a finite number of points of 
discontinuity in which both the one-side limits exist is 
piecewise continuous. 
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EXAMPLES. As we have proved in § 4.5, lima*® = 0. 


xr=0 
This means that the functiOn x? is continuous at the 


point 0 (though it is easily seen that it is a function con- 
tinuous at every point). Similarly, the equation lim cosg 


= 1 = cosO implies the continuity of the function cos a 
at the point 0. 

The function [x] is discontinuous at integer points; 
speaking more precisely: it is right-side continuous, but 
not left-side continuous at these points. 


The function sin is discontinuous at the point 0 


independently of the value that could be given to this 
function at this point; for its limit at the point 0 does 
not exist. The Dirichlet function (cf. § 4.5) is discontinuous 
at every point. 

The notion of continuity may be extended also to the 
points at the infinity, understanding by a function con- 
tinuous at co a function f such that the limit lim f(z) 

=O 


exists. 


5.2. Cauchy characterization of continuity. Geometrical 
interpretation 


The following theorem may be considered as the de- 
finition of continuity (the “Cauchy definition” in dis- 
tinction to the “Heine definition” which we have intro- 
duced in § 5.1). It follows directly from § 4.7, Theorem 3. 

A necessary and sufficient condition for a function f 
to be continuous at a point a is that for any e> 0 there 
exists a number 6 > 0 such that the inequality |ja—a| < ô 
implies |f(w)—f(a)| < e. 

Speaking more figuratively, this means that to suf- 
ficiently small increments of the independent variable 
there correspond arbitrarily small increments of the de- 
pendent variable. This may be written as follows: 


(3) the condition |h| <6 implies |f(a+h)—f(a)| <e. 
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Geometrically, the continuity of a function f at a point a 
means as follows: let P denote a strip parallel to the 
X-axis and containing the straight line y = f(a) inside; 
then there exists a strip Q parallel to the Y-axis and 
containing the straight line x = a inside, such that the 
part of the curve given by the equation y = f(x) included 
in the strip Q, is also included in the strip P. 


a 
Fie. 8 


We may pass from the analytic definition based on 
the Cauchy condition to the above geometrical definition 
immediately, assuming the strip P to be defined by the 
straight lines y = f(a)+« and the strip Q to be defined 
by the straight lines x = a +8. 

It is easily seen from the above definitions that the 
continuity of a function f at a point a is a local property 
in the sense that it depends on the behaviour of the 
function in the neighbourhood of the point a. In order 
to find whether a function f is continuous at a point a 
it suffices to know this function in an arbitrarily small 
interval containing the point a inside. 


5.3. Continuity of elementary functions 


It follows immediately from the formulae on the 
operations on limits of functions (§ 4, (10)-(13)) that the 
arithmetical operations on continuous functions give con- 
tinuous functions, again. Speaking more exactly, if the 
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functions f and g are continuous at a point a, then the sum, 
the difference, the product and the quotient (when g(a) # 0) 
of these functions are continuous at the point a, also. 
For example assuming limf(x) = f(a) and limg(z) = 
z=a t=a 


= g(a) we have 
lim[f (x): g(2)] = lim f(x) limg(x) = f(a): g(a) 


which means that the function f(x): g(x) is continuous 
at the point a. 

Hence it follows that a polynomial is a continuous 
function. 

Namely, the constant function f(x) = const. and the 
function f(x) = æ (the identity) are continuous functions, 
as easily seen. 

More generally, any rational function, i.e. function of 

; _ P(x) 
the form f(x) (a) 


nomials, is a continuous function (obviously at such points 
at which it is defined, i.e. everywhere except of the roots 
of the denominator). 

Before proceeding to the proof of the continuity of 
other elementary functions, let us note that according to 
the formula (1), the continuity of a function f at a point x 
means that umy (ah) = f(x), i.e. that 


(4) imp eke] =0. 


, where P(x) and Q(x) are poly- 


We shall prove now that the exponential function 
a? (a> 0) is continuous. 
Indeed, we have att+*—a*? = a*(a*—1) and lima’ =1 
h=0 
(ef. § 4, (4)). Hence lim(at+*—a*) = 0 and this means 
h=0 
according to the formula (4) that the function a* is 
continuous. 
The trigonometric functions sin and cos are continuous. 
Indeed, 


sin (<z + h)— sing = sin 5. cos (e+ 3) 
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and since |sint] <|t| and |cost| <1, we have 


|sin(«+h)—sina|<|h|, whence lim | sin ( æ+ h)—sing| = 0, 


i.e. 
limsin (z +h)—sing =0. 
h=0 
Similarly, 
Al |. h 
|cos(x +h)— coszj| = 2 sin 5] -/sinje+ > <lh], 
whence 


limcos(x + h)— cosx =0. 
h=0 


sing 
Since tang = EL the function tanz is a continuous 


function as a quotient of continuous functions. The 
functions 
cosg 


1 1 
secs = —-, cotr =——, cosecx = —— 
COs x sing sing 


are also continuous functions (at every x at which they 
are defined). 

Among the elementary functions there remain still 
to consider the functions inverse to the above considered, 
namely, the logarithm and the cyclometric functions. 
However, we shall not prove the continuity of these 
functions now, because it follows from a general theorem 
on the continuity of functions inverse to continuous 
functions which will be proved something later. 

However, we shall prove now that the composition 
of continuous functions is a continuous function. Speaking 
more exactly, if two functions y = f(x) and z = g(y) are 
given and if the function f is continuous at a point a and 
if the function g is continuous at the point f(a), then the 
function g(f(a)) is continuous at the point a. 


For, let lim In = a. Hence lim 7( (£n) = f(a). Writing 


= f(a) and ‘Va = f(a), we have then lim Yn = b, whence 


n=% 
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the continuity of the function g implies 
dim (Yn) =g(b), ie. lim g (f(a) = 9(f(a)) - 


But this means the continuity of the composite function 
g (f(x)) at the point a. 

Hence it follows that taking the elementary functions 
considered in § 4.4 as the starting-point and applying to 
these functions the arithmetical operations and the com- 
position, we yet remain in the domain of continuous 
functions. 

For example the function æ-+tan(x?) is a continuous 


function. Similarly, the function sin- is a continuous 
£ 


function in the set of its arguments, i.e. for « 4 0. But 
the function f defined by the conditions: 


(5) f(x) = sin for «+0 and = f(0)=0 


is discontinuous at the point 0. As we know, the limit 
of the function f at the point 0 does not exist at all 
(cf. § 4.5, (8)). 

Hence it follows also that the function defined by the 
conditions (5) cannot be written by means of continuous 
functions only. Similarly, the function defined as follows: 


f(z) =1 for x40 and f(0)=0 
is discontinuous at the point 0. However, the last function 
may be written by means of a limit. Namely, 


xt f ne 

yooh —— =] Sa he 
fla) imya nace 1+ ny 

Remark. The following formulation of the theorem 
on the composition of functions—a little more general 


than the above—is convenient in applications: ¿f lim f(x) 


telO 


exists and if g is continuous at this point, then 


(6) lim g[f(xz)] =g[ lim f(£)]. 
x=a+0 L=at0 
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The proof remains almost without change. 


EXAMPLE. lim a =1, for 
r= +0 
F ; lim (zlog x) 
lim a% = lim e*lorr — ex~+e 
z=+0 r=+0 


= = 1. 


Here f(x) = vlogx, g(x) = e&. The function f is not de-. 
fined at the point 0; however, it has a right-side limit 
(= 0; cf. § 4.6, (S)) at this point. 


5.4, General properties of continuous functions 


1. THEOREM ON THE UNIFORM CONTINUITY. If a func- 
tion f is continuous in a closed interval a < x < b, then to 
every €> 0 there exists a ô> 0 such that the inequality 
[z—x'| <ô implies |f (£)— f (€ )|< e. 

Before proceeding to the proof, let us note that the 
number ô mentioned in the above theorem does not 
depend on v in distinction to the case of the definition 
of a function continuous at every point æ (belonging 
to the considered set of arguments), where such de- 
pendence holds. This independence of the number 6 of 
the variable xr we emphasize saying “uniform” con- 
tinuity. 

The proof of the theorem will be given by reductio 
ad absurdum. Let us suppose that a number ¢ > 0 exists 
such that, given any ô > 0, there exists a pair of arguments 
x and wv’ such that |e— x| < 6 and |f(#)—f(2’)| > £. Then 


, : tne 1 
in particular, writing 6 = n we conclude that two se- 


quences {£n} and {zp} exist satisfying the following in- 
equalities: 


1 
(i) @%, sb, axla <b; [n=] <> 


and = |f (@n) —f(an)| Se. 


The sequence {x,} being bounded, it contains according 
to the Bolzano-Weierstrass theorem (§ 2.6, 2) a convergent 
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subsequence. Let us write lim Zm, = c. It follows from 


n= 
the first of the inequalities (7) that a < ¢ < b. Hence the 
function f is continuous at the point ¢ and so lim f(£m,) 


= f(e). But the third of the inequalities (7) implies also 
lim Lm, = C, because lim £m, = lim z,,. The continuity of 


Nnm n=00 n= 


the function f gives lim f(£m,) = f(c) as before. Thus 
lim [f (£m) — f (£m,)] = 0. But the last equation is con- 


tradictory to the last of the inequalities (7). 
Hence, the theorem is proved. 
Remark. The assumption that the considered interval 


A ; . ‘ a 3 i 
is closed is essential; e.g. the function 7 8 continuous 


at any point of the open interval 0 < x < 1 but it is not 
uniformly continuous in this interval. 


2. WEIERSTRASS THEOREM. A function f continuous in 
a closed interval a < x < b is bounded and attains its upper 
and lower bounds M and m, i.e. there exist in this interval 
two points c and d such that f(c) = M and f(d) =m. 

First of all we shall prove the boundedness of the 
function f, i.e. that a number A exists such that the 
inequality A > |f(x)| holds for any x belonging to the 
interval ab. Now, by substitution «=1, Theorem 1 
implies the existence of a ô > 0 such that if two points x 
and x’ belong to an interval (contained in the interval ab) 
of the length < ô, then |f(x)—f(x’)| <1. Let us choose 


Z% <ô; dividing the 


a number n in such way that 


interval ab in » equal intervals, the length of everyone 
of them will be less than 6. Thus, denoting the ends of 
these intervals by do, 4,,..-)@n (ao =a, Gn = b), suc- 
cessively, we have 


f(2)—f(a)|<1 for ag<ar<ca, 
whence [f(x)| << 1+|f(a,)|, 
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and in general: 
[f(x)—f(ax)]|<1 for arn SKEI, 


whence 
| f(x)| <1+|f(ax)| . 


Thus, denoting by A the greatest of the numbers 
1+ |f(az)|, where k assumes the values 1,2,...,”, we 
have |f(x)|< A for every x belonging to the interval ab. 

So we have proved that the function f is bounded, 
i.e. that the set of values of this function is bounded. 
Hence, the upper bound M and the lower bound m of 
this set exist (cf. § 1.7). We shall prove by reductio ad 
absurdum that M is one of the values of the function f 
(the proof for m is completely analogous). 

Let us suppose that it is not true, i. e. that we have 

1 
~ M- f(z) 
is defined for any x in the interval a < x < b and is con- 
tinuous in this interval. Hence it is a bounded function, 
as we have just proved. Then a number N exists such 


M —f(x) + 0 for any æ. Then the function g(x) 


that g(x) < N, ie. M— f(z) > A that is f(x) < M- 


But the last inequality proves the existence of a number 
less than M which is greater than all numbers f(x), 
where x takes values from the interval a < x < b. But 
this is contradictory to the assumption that M is the 
upper bound of the function f in this interval. 

Thus, supposing the theorem to be wrong we have 
got a contradiction. 

3. DARBOUX (!) PROPERTY. A function continuous in 
a closed interval a < x <b assumes all values between any 
two values of this function. This means that, if y is a number 
between f(a) and f(b) (i.e. either f(a) < y< f(b) or f(b) 
< y < f(a)), then there exists a ¢ in the interval ab such 
that f(c) = y. 


C) Gaston Darboux (1842-1917), a famous French geometer. 
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Let us assume that f(a) < y < f(b) (in the case of the 
other eventuality, the arguments are completely similar). 
Supposing the theorem to be false, i.e. supposing y— f(x) 
#0 for any x belonging to the interval ab, the function 

1 


h(x) = TESIEN would be bounded by Theorem 2. 
Let M > h(x), ie. let 
f aa 1 
(8) -iwl gr 


Substituting € = 7 in Theorem 1 we conelude that 


a number 6 > 0 exists such that if two points æ and 2’ 
belong to an interval of the length < ô, then 


7 wate’ sire ; b—a 
Let n indicate a positive integer such that aes ô. 


Dividing the segment ab into n equal segments and de- 
noting by do, a,,...,@, the successive ends of these seg- 
ments, as in the proof of the previous theorem, we con- 
clude that 


(9) | f (4s) ~f(@x—1)| < i for k=1,2,..,n. 


Since f(a) <y < f(an), so there exists among the num- 
bers 1,2,...,n the least number m satisfying the con- 
dition y < f(a»). We have m > 0 and f(am-1) < Y < f(@m); 
whence 


O < y— f (am) < f(am)— flam) < s 


by (9), but this contradicts the inequality (8). 
Theorems 2 and 3 lead to the following conclusion: 


4. A function continuous in a closed interval a < £ < 
assumes all values between its lower bound m and upper 
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bound M, including the bounds. In other words, the set of 
values of the function is the closed interval m <y < M. 

Remarks. («) The property of continuous functions 
expressed in Theorem 3 (the so-called Darboux property) 
is especially imtuitive in its geometrical interpretation. 
However, this property does not characterize continuous 
functions, e.g. the function (5) possesses this property 
although it is not continuous. 

(£) Theorem 3 implies immediately the existence of 
Vx for any real x, if n is odd and for any «> 0, if n 
is even. Indeed, if n is odd, then lim 2” = —co and 


T=% 


lim 2” = œ and so the function x” assumes all real values. 
L=00 


Thus the function inverse with regard to x”, i.e. Vr is 
defined for every real a. Similarly, if n is even, then the 
function <", x >0, assumes all values from 0 to oo; 
hence yz is defined for all these values. 

Analogously, it follows from the formulae lim e* = 0 
and lim e* = co that the function e* assumes all positive 
values; hence loge is defined for any positive æ. Finally, 
arctang is defined for every real z. 

Let us add that the formulae § 4.4, (3) imply imme- 
diately the following formulae connecting logarithms, for 
positive a, x and y (a #1): 


(10) logavzy = logar+logay,  log,(z”) = ylogaz, 


log x 


x ertloga C= g 
(11) at = e , logar ona 


For example to prove the first of the formulae (10), 
let us substitute logas = t, loggy = z, ie. £ = al, y = a. 
By § 4.4, (3) we get 
xy = al- a = att?, whence loggry =t+e=log,r+logay. 

The second of the formulae (11) is obtained from the 
second of the formulae (10): 


loga'=tloga, ie. logg = logar loga. 
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In § 4.3 we have seen that a one-to-one function 
y = f(x) defines an inverse function æ = g(y). Now, we 
shall prove that a function inverse with regard to a con- 
tinuous function is also continuous. Speaking more exactly: 


1. If a function y = f(x) is one-to-one and continuous 
in an interval a < x < b, then the inverse function x = g(y) 
is continuous in the interval m <y < M, where m and M 
are the lower bound and the upper bound of the function f. 
respectively. 


Let m < c < M. By Theorem 4 of § 5.4, the function g 
is defined at the point e. Let c = lim yn, where y, belongs 


to the interval mM, i.e. Yn is of the form y, = f (£a). 
It has to be proved that lim g(y,) = g(e). 


Let ¢ = f(d). Thus we have to prove that the con- 
dition lim f(x,) = f(d) implies lim z, = d (because g(¥y,) 


= In, g(c) = d). Since the sequence {æ} is bounded, 
being contained in the interval ab, so the last inequality 
will be proved, if we show that every convergent sub- 
sequence of the sequence {xp} is eonvergent to the limit d 
(cf. § 2.6, Theorem 4). Thus, let lim a, = d’. We shall 


prove that d’=d. The continuity of the function f 
implies lim f(£k,) = f(a’) and since lim f(£k,) = lim f(a) 
R= n=00 


n=00 
= f(d), we get f(d') = f(d). The function f is one-to-one, 
hence we conclude that d’ = d. 


Thus, the theorem is proved. 


APPLICATIONS. (a) logax is a continuous function 
(1 = a> 0), for it is inverse to the continuous function a*. 

(8) The cyclometri¢ functions arcsna,  arccosa, 
arctang etc. are continuous as inverse functions with 
regard to the trigonometric functions (which are con- 
tinuous). 
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(y) Let {an} be a sequence with positive terms. Then 
œo 


the convergence of the infinite product ]] a, implies the 
n=1 


leo] 


convergence of the infinite series > logan. Moreover, there 
n=1 
holds the relation 


= F logas 
(12) log ITa- y logan, ùe. II Ap = ern} 
n=1 n=1 


Similarly, assuming the convergence of the series 2 logan, 


n=] 


the product IT an is convergent, too, and the relation (12) 
n=l] 
takes also place. 

Let Pa = 4: a,:...-a,. The assumption of convergence 
of the sequence {pn} and the continuity of the logarithm 
imply (ef. (2)): 

198} lim Dn = lim log Pn 


and 
lim log pa = lim log (4: ...- an) = lim [log a, +... + logan] 
Tr=00 n=00 n=00 
= > logan. 
n=1 


Similarly, writing s, = loga,+...-+loga, and assuming 
the convergence of the sequence {Ssn}, we have by the 
continuity of the exponential function: 


lim 8, 


e= = lime”, 
n=00 
but 
e” = e08 41+ + F168 an E gn, ni EAn 2 Dn ; 
whence 


lim e” = lim pa. 


N= 00 n=O 


116 Il. FUNCTIONS 


The formula (12) being, as easily seen, a generalization 
of the first of the formulae (10) to the infinite operations 
enables us to transfer many theorems concerning infinite 
series to the case of infinite products. 


2. Every one-to-one function f continuous in an in- 
terval a < x <b is strictly monotone (i.e. either increasing 
or decreasing ). 


Our assumption implies f(a) 4 f(b) and we may further 
assume that f(a) < f(b) (if f(a) > f(b), then analogous 
arguments are applicable). We shall prove the function f 
to be increasing in axx <b. Let x< æ’. One has to 
prove that f(x) < f(x’). 

First of all let us note that the conditions a < æ < b 
and f(a) < f(b) imply f(a) < f(x) < f(b). Indeed, otherwise 
we should have either f(r) < f(a) or f(x) > f(b). In the 
first case, the double inequality f(x) < f(a) < f(b) would 
imply (by Theorem 3) the existence of a point x” in the 
interval 2b such that f(x”) = f(a). But this contradicts 
the assumption that f is one-to-one (because x” Æ a). 
Similarly, in the other case a point z” would exist in the 
interval az such that f(x”) = f(b), in contradiction to the 
inequality x” Æ b. 

So we have proved that f(a) < f(x)< f(b). At the 
same time we conclude that the conditions «<2’ <b 
and f(x) < f(b) imply f(x) < f(x’) < f(b). 

Thus, f(x) < f(z’), as we had to prove. 


Exercises on § 5 


1. Let f(x) denote a function defined as follows: if a 
is an irrational number, then f(c) = 0, and if x is a ra- 


tional number x E (the fraction i being irreducible), 


then f(x) = F Prove that this function is continuous at 


irrational points and discontinuous at rational points. 
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2. Prove that every function f(x), a < æ < b, one-to- 
one and possessing the Darboux property (§ 5.4, Re- 
mark («)) is continuous. 


3. Prove that every equation of an odd degree » with 
real coefficients, i.e. equation of the form xv” + a,_,a2"-!+ 
+...+4,r+a,=0 has at least one real root (ef. Exer- 
cise 2, § 4). 


4. Prove that a continuous function satisfying the 
condition 


f(t y) = f(x) + f(y) 
for any x and y is of the form f(x) = ax. 


(Prove this equation for rational x, taking a = f(1)) 
5. Find whether the function sin + is uniformly con- 


tinuous in the interval 0 < x< 1, and the function yx 
in the interval 0 <z < oo. 


6. Let f(x) and g(x) be two continuous functions in 
an interval a<x<b. Let A(x) denote the greater of 
the two values f(z) and g(x) (eventually their common 
value, if they are equal). Prove that h(x) is continuous. 


7. Given a sequence a, ds, ..., choose a function dis- 
continuous at the points of this sequence and continuous 
at all other points. 


8. A function f is said to satisfy the Lipschitz condition, 
if a constant C exists such that the inequality 


f(x) — f(x) < Cla—2"| 


holds for any pair x and 2’. 

Characterize the Lipschitz condition geometrically. 

Prove that a function satisfying the Lipschitz con- 
dition (in an interval which may be closed or open, 
bounded or unbounded) is uniformly continuous. 

Show by an example that the converse theorem does 
not hold. 
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§ 6. SEQUENCES AND SERIES OF FUNCTIONS 


6.1. Uniform convergence 


If to any positive integer n there corresponds a func- 
tion fn, then a sequence of functions fi, fe, ...)fny-.. is 
defined. Let us assume all these functions to be defined 
in the same set of arguments A (e.g. in an interval 
a@<a<b). If the sequence f,(x), f(x), ... is convergent 
for every x (belonging to A) to a limit f(x), then we say 
that the sequence of functions {f,} is convergent to the 
function f. This means by the definition of the limit 
(§ 2.2) that to every x and to any «> 0 a number k 
exists such that for n > k the inequality 


(1) [fn(w)—f(x)|<e 
holds. 

Thus, given «> 0, the number k is chosen suitably 
to any x, separately. However, if k can be chosen in- 
dependently of x, then the convergence of our sequence 
is said to be uniform. Thus, a sequence {fn} is uniformly 
convergent to a function f (in a set A), if to any e> 0 
a number k exists such that for each n >k and for 
every x (belonging to A) the inequality (1) holds. 

Geometrically, the uniform convergence means that 
surrounding the limit-curve y = f(x) with a strip defined 
by two curves parallel to it (given by the equations 
y = f(x) +e), all curves y = f,(@) with sufficiently large n 
are contained in this strip. 


EXAMPLES. Let f (x) = a". We have 
lim fa(£)=0 for O<a#<1 


and limf,(v)=1 for w«v=1. 


NCO 


This sequence is uniformly convergent in the interval 
O<a2<h. 
For, given «> 0, let us choose a number k in such 
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n 
way that z <e. Then assuming x < ; we have r” < (3) 


1 . F tas 
<E< for n > k and the inequality (1) is satisfied by 


each n>k and by any œ belonging to the interval 
0<2<4. But this means that the convergence of the 
sequence {fn} in this interval is uniform. Yet the con- 
vergence in the interval 0 <s =< 1 is not uniform. This 
is easily seen substituting e.g. e = 3; moreover, it follows 
immediately from the discontinuity of the limit-function 
and from the following theorem: 

1. A limit of a uniformly convergent sequence of con- 
tinuous functions is continuous. 

Let the sequence {fn} be uniformly convergent to f 
(in a set A) and let > 0. Then there is a k such that 
for each n > k, the inequality 


(2) [fn(w) — f(w)| < $e 

is satisfied for every x (belonging to A). Let a be an 
arbitrary point belonging to A. We have to prove that 
the function f is continuous at this point. Thus, given e, 


a number 6> 0 has to be chosen in such a way that 
the inequality !x—a| < ô would imply 
(3) f(x) —fla)|<e 
(for x belonging to A). 

Now, f, being continuous at the point a, a number 
6 > 0 exists such that the inequality |v—a|< ô implies 
(4) fale) — fia)| < fe 

The inequality (2) being satisfied for n = k and x = a, 
we find that 
(5) [fela) —f(a)| < 3e. 


Replacing n in the inequality (2) by k and adding 
to the mequality obtained in this way the inequalities (4) 
and (5), we get the inequality (3), as was required. 
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Remark. As we have seen, the function f(x) = lim g” 


N=00 
(cf. Fig. 9) is discontinuous in the interval 0<a2<1. 
Thus, the limit of a non-uniformly convergent sequence 
of continuous functions may be discontinuous. Theorem 1 
and the above example illustrate the meaning of the 
notion of uniform convergence. 


Fic. 9 


Similarly as in the case of the uniform continuity 
of a function, the expression “uniform” shows that the 
number k chosen to a given « is independent of g. 

The following theorem corresponds to the Cauchy 
condition for the convergence of a sequence: 


2, A necessary and sufficient condition for the uniform 
convergence of a sequence of functions {f,} is that to any 
é€>0 a number r exists such that the inequality 


holds for each n> rr. 


First let us assume the sequence to be uniformly 
convergent to a function f. Then, given a number e > 0, 
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there exists an r such that for each » >r, we have 
lfn(x) ~ f (x)| <fte, whence \f-(a) — f (x)| < łe. 


Adding both these inequalities we obtain the in- 
equality (6). 

Now, let us assume a sequence {fn} to satisfy the 
condition formulated in the theorem. Then the sequence 
f(x), fo(xv), ... satisfies for a fixed x the Cauchy condition; 
thence it is convergent. Speaking otherwise, the function 
f(x) = lim f,(#) exists. It has to be proved that the con- 


vergence is uniform. Let an €> 0 be given. According 
to the assumption, an r exists such that the inequality 
(7) fale) — fr(x)| < $e 
holds for each n >r. 

We shall prove that for n> r, the inequality (1) 
holds, too (with the sign < instead of <). 

Replacing the variable n by m in formula (7) and 
adding to the inequality (7) the obtained inequality 
lfm(x)—f-(2)| < fe, we get for m>r, 


[fu(@)—fm(x)|<e, whence lim |fnp(x)—fm(x)| <e, 
i.e. 
| lim [fn(@)—fm(x)]| <e, that is  |fa(æ)— lim fmlæ)| <e 


and so 


[fn(x)— f(w)| <e. 


6.2. Uniformly convergent series 


Let a sequence of functions fi, fe,...,fn,... defined 
on the same set of arguments be given. 

The series fi(£) + f,(7) +... +fn(v) +... is called uniformly 
convergent, if the sequence of its partial sums 


Sala) = file) + fav) +... + fala) 
is uniformly convergent. 
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If the functions f,,f,,... are continuous, then the 
partial sums s, are obviously also continuous. By the 
theorems of § 6.1, we therefore conclude that 

1. The sum of a uniformly convergent sequence of con- 
tinuous functions is a continuous function. 

2. A necessary and sufficient condition for the uniform 
convergence of a series f,(x)+ f(x) +... is that to any number 
e>0 a number k exists such that the inequality 


(8) [fx(@) + frga(e) +... +frle)| < E 
holds for each n> k and for any z. 


From Theorem 2 we may deduce the following theorem 
which makes it possible to infer the uniform convergence 


Leo] 

of a series > fp(x) by comparison of the terms of this 
n=1 es 

series with the terms of a series > un. 


n=1 


o 
3. If a series >. un is convergent and if the inequality 
n=1 
oo 


[fn(w)| < Un is satisfied for any x, then the series X falx) 
converges uniformly and absolutely. as 

Indeed, since the series u,+%,.+... is convergent, 
therefore to any given ¢>0 a number k exists such 
that the inequality u,+ vzii+...+Un < e€ is satisfied for 
each n> k. Hence by the assumption, 


[fa (2) + ne + f(@)| <[fic@)| +--+ [fal @)| < te Pon tn < E; 
thus the formula (8) holds and, by Theorem 2, this implies 


oo 
the uniform convergence of the series > falz). 


n=l 
The second part of the above double inequality es- 
tablishes at once the absolute convergence of the series. 


Fe 


[ee] 

EXAMPLE. The series >; — is uniformly convergent 
=o 7%: 

ý M a” 


in every interval —a <x<a, since zil <y and the 
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n 
series > aI is convergent for any a (§ 3.7). 


n=0 
We shall encounter many more examples of uniformly 
convergent series in § 6.3 below. 


6.3. Power series 


A series of the form 


(9) S(a) = + ar +a +... Hane” 7) ana” (1) 
n=O 
is called a power series. 

Thus we see that a power series is a natural generaliza- 
tion of the notion of a polynomial of degree n. The im- 
portance of power series follows also from the fact that 
the representation of a function by means of a power 
series is very advantageous from the point of view of 
practical calculations. 

Let us consider the following three examples of power 
Series: 


(a) 1+5 ot tat (b) L+ote’+ae+.., 


(ce) 141!0o42!2?+ 3!a8+... 


As well known, the first of these series is convergent 
for all æ. The second one is convergent for |z|<1 and 


: 1 f ; ; 
its sum as ae for other x the series is divergent. 


Finally, the third series is divergent for every æ Æ 0. 


In order to formulate a general theorem on the con- 
vergence of power series, the notion of the “radius of 
convergence”’ of a power series will be introduced. Namely, 
the radius of convergence of a power series S(x) is defined 

foe) 

() Strictly speaking, for x = 0 the symbol $ a,2* (which is 

n=0 
in this case indefinite) has to be replaced by a, (cf. the footnote 
to the formula (6), § 1). 
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as the upper bound of the set of absolute values of x 
for which this series is convergent. In particular, if the 
above set is unbounded, then the radius of convergence 
is assumed to be equal to oo. 

For example the radii of convergence of the series 
(a), (b) and (c) are œ, 1 and 0, respectively. l 

The interval —r < x <r, where r denotes the radius 
of convergence of a given power series, is called its interval 
of convergence. In the case r= oo, the interval of con- 
vergence is equal to the set of all real numbers. This 
terminology is connected with the following theorem: 


1. In any closed interval lying inside the interval of 
convergence the power series is convergent uniformly and 
absolutely. 


It suffices to prove our theorem for intervals of the 
form —e < x <c, where c < r (because every closed inter- 
val lying inside the interval of convergence is contained 
in such an interval with the centre 0). Since r, being the 
radius of convergence, is the upper bound of the set of 
absolute values of the convergence-points of the series S (<), 
so a point b> ¢ exists such that either S(b) or S(—b) is 
convergent. It follows from the convergence of the series 
S(+b) that its terms constitute a bounded sequence. 
Thus, let M > |a,b"| for each n. Hence we conclude that 
for |æ| <c, we have 


a |" c\" 
lans | =]4,b"|- 5 < m(5) : 
~ c n 
Since the series J (z) , being a geometric series with 
n=0 


quotient <1, is convergent, Theorem 3 of § 6.2 implies 
the uniform and absolute convergence of the series S(x) 
in the interval —c S£ <e. 

Remark. We conclude from the above theorem that 
the series is convergent inside its interval of convergence 
and divergent outside this interval (the last follows from 


6. SEQUENCES AND SERIES OF FUNCTIONS 125 


the definition of the radius of convergence). Yet at the 
ends of the interval of convergence the series may be 
convergent as well as divergent. The following examples 
give evidence here: the series (b) is divergent at the ends 
of the interval of convergence, namely, S(1) = œ and 
the series S(—1) = 1—1+1—1+... has neither a finite 
nor an infinite limit; the series 


(representing log(1+2)) is convergent for «=1 and 
divergent to —oco for x = —1. 

The previous theorem together with Theorem 1 of 
§ 6.2 imply: 

2. A power series S(x) ts a continuous function in the 
open interval —r<x<r, ie. inside the interval of con- 
vergence. 

Indeed, to any x lying between —r and r there may 
be chosen a closed interval with the centre v, lying inside 
the interval of convergence. Since the power series is 
uniformly convergent in this closed interval, it follows 
from Theorem 1 of § 6.2, that it represents a continuous 
function. 

Applying Abel’s theorem from the theory of infinite 
series (§ 3.3, Theorem 2) we shall complete this theorem 
with respect to the continuity of the power series at the 
ends of the interval of convergence. 

3. ABEL THEOREM. A power series convergent at one 
of the ends of its interval of convergence constitutes a (one-side ) 
continuous function at this point. 

Speaking more strictly, if the series S(r} (or S(—1)) 
is convergent, then the series S(x) is uniformly convergent 
in the interval 0 < æ <r (cr in the interval —r < æ < 0). 

Let us assume the series S(r) to be convergent and 
let us denote by R, the n-th remainder of this series, i.e. 


Rn = Angi Tt! + any artt +. 
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Then we have lim Rk, = 0. Let an e>0 be given. 


N= 


Thus a number k exists such that we have 


lanpi rrt +... + a;r] <E 

for i>n>k. 

Let us denote by R,(z) the n-th remainder of the 
series S(z): 

Ry(X) = Any 24? + Ange art? +... 
Hence, in particular, #,(r)-= Rn. Let us note that 
n+l +2 

Ra(£) = appr” +! c) + anpor” t? (Fy “Piva 


and let us apply Abel’s theorem (§ 3.3, 2 and Remark («)) 


n+l 
after replacing the sequence {a,} by the sequence (?) A 
x 


n+2 
(7) »--. and the series b,-+).+... by the series Rn. 


Since this series is bounded by the number e and since 
n+l n+2 p\ m 
1> () > (3 >.. and lim G =0 for O<gæ<r, 
r r m= \"" 


we conclude that | Ra(£)| < 2e. This inequality is satisfied 
also for x = r. Thus we have shown that if n > k, then 
the inequality 


y AmE” — S amam] < 2e 


m=0 m=0 


is satisfied for any x such that 0<a<r. This means 
that the series S(x) is uniformly convergent in this interval. 

In the case when the series S(—r) is convergent the 
arguments are analogous. 

Theorems 2 and 3 may be expressed also in the follow- 
ing way: every point of convergence of a power series is 
a point of continuity. 

Sometimes the d’Alembert and Cauchy criteria enable 
us to calculate the radius of convergence easily. Namely: 
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4. Tf lim |Z 
n=00 


the power series K(x) is equal to r = 1fy (moreover, if g = 0, 
then r = co and if g = œ, then r = 0). 


= g, then the radius of convergence of 


n 


Analogously, if lim Vian! exists, then r = eee ore 

nao lim y |an] 
Nam 
Indeed, let x> 0. We obtain 


Gn 410") 
Ay x” 


An+1 


= g- lim 


n= 


(10) lim 


n= 


= gg. 
n 

Hence if æ < 1/g, then the considered limit is <1 
and so the series S(x) is convergent (absolutely), whence 
r >1/g. Supposing r > 1/g, the series S(x) would be ab- 
solutely convergent for 1/g < x < r. But this is impossible, 
since then the limit considered in the formula (10) would 
be >1. 

The above arguments concern also the cases g = 0 
or g =œ. 

The proof in the case of the Cauchy criterion is 
similar. 


6.4. Approximation of continuous functions by polygonal 
functions 


A function f(z), a <x «< b, is called polygonal, if the 
interval ab may be divided into a finite number of smaller 
intervals in such a way that the function is linear in 
everyone of these intervals, separately. This means that 
there exist a system of n+1 points 


(11) a<, <... <an, where a,=a, a,=b, 


and two systems of real numbers ¢,,¢,...,¢, and 
di, dz, ..., dn So that 
(12) f(z) =a r7+d, for akı KT <ar 


(k =1,2,..., n). 
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For example the function f(x) = |æ] is polygonal in the 
interval —1 <a < 1, for f(x) = —z in the interval —1, 0, 
and {(#) =« in the interval 0, 1. 

The graph of a polygonal function is a polygonal line. 
Conversely, if a polygonal line is the graph of a function, 
then this function is a polygonal one. 

Sometimes we are dealing with approximation of 
curves by polygonal lines (e.g. in the elementary geo- 
metry, calculating the length of the arc of a circle, we 
approximate this arc by inscribed and circumscribed 
polygonal lines). 


Fie. 10 


The following theorem expresses analytically the ap- 
proximation of curves given by continuous functions by 
polygonal lines (given by polygonal functions): 

THEOREM. Every continuous function f in an interval 
a<x<b is the limit of a uniformly convergent sequence 
of polygonal functions. 

For each n, we consider the partition of the segment 
ab into n equal segments: aa,, a,4,,...,Q,-10 (thus we 
have in general a, = a+ r’), We draw a polygonal line 
through the points [a, f(a)], La, f(%:)]; ---, [any f (an)]. 
This polygonal line is the graph of a certain polygonal 
function fa. We shall prove that the sequence of the 
functions f, is uniformly convergent to the function f. 
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According to the uniform continuity of the function f 
in the interval ab, to any given ¢>0 a number 6> 0 
may be chosen so that the inequality |z—a’| < 6 implies 


|f(2)—f(a@’)| < e. Let m> mn. We shall prove that for 


ô 
n>m we have the inequality 
(13) lfn(ae) — f(w)| < 2e 


for every x belonging to the interval ab. 

Indeed, let x be given and let n > m. Moreover, let 
the point x belong to the interval a,_,a, (of the n-th 
partition). Since the length of this interval is <ô, so 


(14) |f(ax-1)—f(ax)|<e and = |f(x)—f(ax)| <e. 


Let us suppose that f(ax—ı) < f(a) (if f(@x-1) > f (ax), 
then the arguments are analogous). Then the function fa 
is non-decreasing in a,—,4,, since it is linear. Thus 


(15) fanları) < fal®) < fn (ax) - 


Since, according to the definition of the function fn, we 
have fn(@x—1) = f(@x—1) and falar) = f (ax), 80 f (4x1) < fr(@) 
<f(a,) and this gives, according to the first of the in- 
equalities (14), |fn(x)—f(ax)| < £. Comparing this inequality 
with the second of the inequalities (14) we obtain the 
formula (13). 

We shall now cite without proof the following Weier- 
strass theorem, analogous to the previous one: 

Every function continuous in an interval axa<b is 
the limit of a uniformly convergent sequence of polynomials. 


6.5*. The symbolism of mathematical logic 


In order to understand better the notions and the 
theorems of mathematical analysis, a knowledge of the 
notation of definitions and theorems by means of some 
symbols used in mathematical logic is required. 

We shall give here the principal notions and symbols 
employed in mathematical analysis. 
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Given two sentences a and f, we denote by av the 
sentence ‘‘a or f” (the sum, ie. the alternative of the 
sentences a and f); a A f will denote the sentence ‘ʻa and 8” 
(the product, i.e. the conjunction of the sentences a and £). 

Every sentence has one of the two values: truth (in- 
dicated by the figure 1) and falsehood (indicated by 0). 
A logical sum avf is a true sentence, if and only if at 
least one of its terms is a true sentence. Similarly, 
a logical product a^ is a true sentence, if and only if 
both its factors are true sentences. 

It is easy to show that logical addition and multi- 
plication possess the properties of the commutativity and 
the associativity: 


avB=Bva, arp=Bara, av(Bvy)=lavB)vy, 
an(Bry) = (arB)ry. 
The laws of distributivity also hold: 


aN(Bvy) = (aAB)v (ary) 
and av(BAy) = (avB)A(avy). 


Besides the above two operations, the negation of the 
sentence a, indicated by ~a, is also considered. It is 
clear that the sentence ~a is true, if the sentence a is 
false, and is false, if the sentence a is true. Moreover, 
it is immediately seen that 


(16) ~(~a)=a 
(two negations are reducing themselves). 

The following two theorems (so-called de Morgan laws) 
may also be easily proved: 
(17) ~(avB) = (~a)A(~8) 

and = —~(aAf)=(~a)v(~8). 

The first of these two theorems states that the sentence 

that one of the two sentences a and f is true, is a false 


sentence if and only if both sentences ~a and ~ are 
true, i.e. if and only if both sentences a and # are false. 
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The second theorem states that “it is not true that 
both sentences a and f are true, simultaneously”, if and 
only if at least one of these sentences is false. 

Besides the operations of addition, multiplication and 
negation, the relation of implication is considered in the 
logic of sentences. Namely, we write a-—f in order to 
denote that the sentence a implies the sentence £, i.e. that 
if a is true, then f is true, too; in other words, either a 
is false or ĝ is true. This means that the sentence a> 
is equivalent to the logical sum (~a)v £f. Hence it follows 
also by the formulae (17) and (16) that 


(18) ~(a+B) =ar(~8). 


The operations of addition and multiplication may be 
extended to a finite number of terms or factors by 
induction. The generalization of these operations to an 
arbitrary number (finite or infinite) of terms or factors 
plays a great role in applications. We perform it in the 
following way. 

Let g(x) be an expression containing a variable x 
and becoming a sentence (true or false) after substituting 
in place of x any value of x. Such an expression is called 
a propositional function; e.g. the expression «> 2 is 
a propositional function. It becomes a sentence, when 
we substitute any real number in place of 2; however, 
it is not a sentence. We say that the values of the variable x 
for which (x) is a true sentence, satisfy this propositional 
function. 

We perform the following two operations on the pro- 
positional functions: 

(19) Vee) and = / 9(#). 


T 


The first expression is read as follows: “a certain x satis- 
fies the function ¢”’ (that is “there exists an x, such that 
p(T) is true”). The second one means that “every s 
satisfies the function g(x)” (that is “for every a the 
sentence g(x) is true”). 
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As is easily seen, the expressions (19) are sentences; 
e.g. V (x > 2) is a true sentence and A (x> 2) is a false 


z bl x 
sentence. Generally, by adding the operator A or V 


(these operators are called the universal and the existential 
quantifier respectively) before a propositional function we 
transform the propositional function into a sentence. 
Writing the variable x we have to realize the domain 
of this variable (this domain is often suggested by the 
symbolism); e.g. for the propositional function a > 2, 
the domain of the variable x is the set of real numbers. 
In the case when the domain of the variable is finite, 
the quantifiers V and A are generalizations of the 
operations v and ^, respectively. Indeed, if the domain 
of the variable x consists of n elements 4,, az, ..., An, then 


V ¢(@) = [¢(a,)Vp(ae) V... VP(an)], 


A p(x) = [p(a) Ap (a2)... Ap(an)]. 


The de Morgan laws may be generalized to the quan- 
tifiers. In this way we have the theorems: 

(20) ~V glz) = A~g(s) and ~Agp(z)= V ~¢9(z). 
zx x =x x 

Indeed, “it is not true that there exists a value of x 
for which g(x)? is a true sentence, if and only if the 
sentence g(x) is false for every x, that is if the sentence 
~p(x) is true. 

The second de Morgan formula may be shown to be 
true, similarly. 

Besides propositional functions of one variable, pro- 
positional functions of two or more variables are con- 
sidered; e.g. y = 2 is a propositional function of two 
variables (we might denote this function by (7, y)); 
it becomes a sentence after substituting in place of the 
variables x and y some values of these variables. Similarly, 
z=a+y is a propositional function of three variables. 
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Let us now write the definition of the limit of an 
infinite sequence (cf. § 2.2) by means of these logical 
symbols: 


(21) (g= lim an) =) VA [(n > k)—>(lan—g| < e)]; 


here the domain of the variables n and k is the set of 
positive integers and the domain of the variable e is the 
set of positive numbers. 

Similarly, the Cauchy condition, necessary and suf- 
ficient for the convergence of a sequence {an} (cf. § 2.7,, 
is expressed as follows: 


(22) A VA [(n > r)—>(lan— ar] < €)]. 


€ r 


The definition of the boundedness of a function f 
in an interval a < g <b (cf. § 4.7) is written as follows: 


(23) VA |f(2)| <M. 
M x 


The (Cauchy) definition of the continuity of a func- 
tion f at a point a, (cf. § 5.2 (3)) may be written in the 
following way: 


(24) AVA [A] < ò> (If(@0+4)—f(m)] < )] 


Here the domain of « and ô is evidently the set of 
positive numbers and the domain of the variable h, the 
set of all real numbers. 

Since, according to the definition, a function is con- 
tinuous in a given set (e.g. for a<a<b) when it is 
continuous at every point of this set, so to write the 
definition of continuity in a set by means of the logical 
symbols, one has to precede the expression in the for- 
mula (24) by the quantifier A replacing of course 2, 
by x. In this way we obtain: 7 


(25) AN VA [0A] < ô) — (lf (£ +h)— f (2)| < e)] . 


Before proceeđing to further applications of the logical 
symbols, we note a few simple properties of the quantifiers. 
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Let a propositional function y(z,y) of two variables 
be given. It may be easily verified that the formulae 


(26) AN p(z, y) = AN ple, y) 


and VV (z, y) = VV elm, y) 


hold. 

Thus, as we see, the order of two universal quantifiers 
may be changed, as well as the order of two existential 
quantifiers. However, this is not true in the case of two 
different quantifiers V and A; e.g. changing the order 
of the quantifiers in the formula (23) expressing the 
condition of boundedness of the function f we obtain 


(27) AN (f(#) < m); 


but the last condition is satisfied by every function 
(and so by unbounded functions, too), which is seen 
substituting M = |f(#)|+1. 

So the order of the quantifiers V and A is essential; 
e.g. it is essential in the condition (23) (for the boundedness 
of the function f) that the number M does not depend 
on the variable v; in the condition (27) it is quite opposite: 
we choose the number M to each v, separately. As is seen, 
the dependence of a certain quantity on another one is 
expressed by the order of the quantifiers; thus, it follows 
directly from the notation. Similarly, in the definition (24) 
(expressing the continuity of a function f at a point sọ) 
the order of the quantifiers A and M means that 6 


depends on £ (and not conversely). 

We illustrate this situation further by two especially 
instructive examples, namely, the example of uniform 
continuity and that of uniform convergence. 

First let us note that changing the order of the quan- 
tifiers A A in the formula (25) (expressing the con- 

T E€ 


tinuity of a function) we obtain an equivalent sentence 


6. SEQUENCES AND SERIES OF FUNCTIONS 135 


(since the change concerns the same quantifiers, cf. the 
formula (26)): 


(28) AAVA [h <8)->((f(e@+h)—f(@)| <9]. 


However, changing the order of the quantifiers A V 
xz 6 


in the formula (28) we obtain a non-equivalent formula, 
namely 


(29) AVAA [h <8) >1f@+8)—F@) < a), 


i.e. the condition of the uniform continuity of the func- 
tion f in the considered set (cf. § 5.4); but not every 
function continuous in the interval a < æ < b is uniformly 
continuous (e. g. the function 1/x is continuous in the 
interval 0 < z < 1 but it is not uniformly continuous in 
this interval, cf. the remark to Theorem 1 of § 5.4). 
Although for closed intervals a <v <b, the usual con- 
tinuity implies the uniform continuity, but this requires 
a special proof (to pass from the formulation in Theorem 1, 
of § 5.4 to the formula (29), x’ has to be replaced by æ+ hk). 

Comparing the formulae (28) and (29) we conclude 
that they differ only by the order of the quantifiers A 


z 
and V. However, this difference is very essential: the 


ô 
order VA (in the formula (29)) expresses the inde- 
ô x 


pendence of the number ô of the variable v and “uni- 
formity” of the continuity of the function f consists just 
in this fact. 

Now, let us proceed to the notion of the uniform 
convergence of a sequence of functions (cf. § 6.1). Let 
a sequence of functions fi, f2, ..., fn, ... defined in a certain 
set (e. g.a < x < b) be given. Let us assume this sequence 
to be convergent to a function f. This means by the 
formula (21) (after substituting g = f(x), an = fn(x)) that 


(30) AANA [(n > k) > (fala) —f(x)| < 6)]. 
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As is known, the order of the quantifiers A A may 
T € 


be changed in this formula. However, if we change also 
the order of the quantifiers A and V, then we obtain 
z k 


the formula for uniform convergence: 
(31) AVAMA [a> k) (fate) =f) < £)] 


For, the order of quantifiers in the formula (31) shows 
that the number k does not depend on æ (but only on e) 
and this means that the convergence of the sequence of 
functions fi, fo,... is uniform. 

To conclude these remarks we add that sometimes 
it is convenient to apply the logical symbolism and 
especially the de Morgan formulae to proofs performed 
by reductio ad absurdum. 

For this purpose let us note that the de Morgan 
formulae (20) may be applied to propositional functions 
of many variables; they give the following formulae: 


~VA plL, y) = AV ~ oles 9) ’ 
MAN IOs aha NIN ees ae) ete. 


zt Yy z 


(32) 


For example in the proof of the theorein on the 
uniform continuity of functions continuous in a closed 
interval (cf. § 5.4, 1), we use the condition of the uniform 
continuity given in the following formulation (which does 
not differ essentially from the formula (29)): 


A VAA [(|a—a| < 6) (|f(x)—f{a’)| < e)]. 


We write the negation of this condition, which gives 
according to the formulae (32) and (18), 


VA VY [læs] < 8a (f2) =a] > a}. 


The continuation of the proof remains unchanged. 
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Exercises on § 6 


1. Prove that the sum of two uniformly convergent 
sequences is uniformly convergent. Prove the same for 
a product, assuming a < x < b. Show by considering the 


example fa(£) = o(1- 3), gal) =< that the theorem 


2 
on the product is false for open intervals. 
2. Prove that the radius of convergence r of a power 


lo e] 


series Í a, 2” satisfies the (Cauchy-Hadamard) formula: 


n=0 
; = limsup Van]. 


3. Let a sequence of continuous functions f1, f2, ... in the 
interval a < x < b, be given. Prove that this sequence is 
uniformly convergent to a function f, if and only if the 
condition lim æ, = x implies lim fu(8n) = f (£). 

N=00 


n= 
4. Investigate the uniform convergence of the sequence 
of functions 


falx) =a" 1—a2"), O<a<l1 
and fal£) ==, O<2 < 1. 


5. Prove that the series 
S(x) = c(1—2xz)—a(1—2x) +... + a™(1—2)—a"(1—2)+... 


is uniformly and absolutely convergent in the interval 
O0<zr<l. 

Rearrange the terms of this series in such a way to 
obtain a nonuniformly convergent series in this interval. 


CHAPTER III 


DIFFERENTIAL CALCULUS 


§ 7. DERIVATIVES OF THE FIRST ORDER 


7.1. Definitions (') 


Let a function f be given in an open interval con- 
taining the point a. The limit 
mf 2th —F(a) 
h=0 h 
is called the derivative of the function f at the point a. 
The function 


the limit of which is considered by h tending to 0, is 
called the difference quotient of the function f at the point a 
for the increment h. 

The derivative is written symbolically as follows: 


df(z))  _, f(a+h—f(a) 
(1) dz | __ =m h 


or more briefly, f'(a). Yet more briefly, writing y = f(x) 
we denote the derivative of a function f at an arbitrary 


point x by A (the derivative “dy over dæ”). By this 


symbolism (originating with Leibniz), the derivative is 
represented as a quotient of two differentials dy and dx 


(cf. § 7.13). However, the symbol < must be treated 


(1) The differential and integral calculus was created by Newton 
and Leibniz on the end of the 17th century. 
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as a whole, attributing to the differentials no separate 
mathematical significance. 

Geometrically, the derivative is interpreted as follows. 
Let a curve y = f(x) be given. Let us draw a straight 
line through the points [a,f(a)] and [a+h,f(a+A)], 
h being a fixed positive value. This straight line is called 
a secant with regard to the given curve. It is easily seen 
that the difference quotient g(h) is the tangent of the 
angle a, between the secant directed by the increasing 
abscissae and the positive direction of the X-axis. The 


Fig. 11 


limiting position to which the secant tends as hk tends 
to 0 will be considered as the position of the tangent. Thus, 
(2) f'(a) = tana, 

where a is the angle between the positive direction of 
the tangent to the curve y = f(x) at the point a and the 
positive direction of the X-axis. 

Not every continuous function possesses a derivative, 
i.e. not every curve possesses a tangent at any point. 
E. g. the function f(x) = |x| does not possess a derivative 
at the point 0, for in this case 

lim i e oH) =1 and lim ——~— 


hm +0 h= —0 


TOOR 
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In this case we may speak about one-side derivatives 
which are equal to 1 and —1, respectively. Generally, 
a right-side or left-side derivative is the right-side or 
left-side limit: 


h=—0 h ’ 


(3) f+(4) = io 


respectively. 

However, there exist continuous functions which do 
not even have a one-side derivative. It is easily seen that 
the function f defined by the conditions 


(4) f(x) = #sin = for x20, f(0)=0 


is continuous but has no derivative at the point 0. 


Fig. 12 


For, substituting for h the two sequences of values 
Bee gn. Coo es 
T? Bn’? On? 3x? Tn’? ilr’? 
we get in the limit 1 in the first case and in the second 
one, —1. 
The non-existence of the derivative f'(0) follows also 


P eo satires 
from the non-existence of the limit lim sin=» since we 
z=0 
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should have 
(0) = lim LEAO L timsin = 


(cf. § 4 (8)). 

There exist still more singular continuous functions, 
namely functions which do not have a derivative at any 
point; thus, they represent continuous curves which do 
not have a tangent at any point. 

Besides finite derivatives we consider also infinite 
derivatives. For example we shall prove that 


(ve) T (yz) he 


ax 
Indeed, 


=lim = lim == = o0, 


for lim}? = 0. Analogously lim yh =+ 0, whence the 
h=+0 


h=0 
second formula follows. 

A function is called differentiable in an open interval 
if it has a finite derivative at any point of this interval; 
in saying that a function is differentiable in a closed 
interval a << <b we assume that it has a derivative 
at any point inside this interval and one-side derivatives 
at the ends of this interval. 

Similarly, the assumption of continuity of the de- 
rivative f'(x) in the interval a <x <b means that this 
derivative is continuous inside the interval ab, the right- 
side derivative is right-side continuous at the point a 
and the left-side derivative is left-side continuous at b. 

By a normal to a curve y = f(x) at a point [x, f(x)] 
we understand a straight line perpendicular to the tangent 
at this point and passing through this point. 

According to the geometrical interpretation of the 
derivative given above, the angent to a curve at a point 
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(x, y), where y = f(x), is expressed by the equation 

Y—y 

5 = 
X and Y denote the coordinates on the tangent. 

Thus, the equation of the normal to a curve at a point 


=f(x) or X= if f(x) =00; 


(x, y) is: 
© Fre o Yay, if fa) =o. 


Besides the geometrical interpretation the derivative 
has also important interpretations in physics. In particular, 
the velocity of the point moving along a straight line is 
expressed as the derivative of the distance with respect 


to the time: v = a where the distance s travelled is 


dt’ 
expressed as a function of the time: s = f(t). Thus, the 
velocity at a moment ¢ is the limit of the mean velocity 
in the time from ¢ to t+A, if h tends to 0; for the dif- 


ferences quotient is just this mean velocity. 


7.2. Differentiation of elementary functions 


First let us note that 
1. If a function f is differentiable at a point x, then 
it is continuous at this point. 


Indeed, since the limit im Oe exists by 


h=0 l 
assumption (and is finite), we have 


lim[f(x+h)— f(xy] = lim Ket hai). limh = 0, 
h=0 hed h=0 


whence 
limf(x+h) = f(x), 
h=0 
which means that the function f is continuous at the 
point v. 
2. Let a function f have a constant value: f(x) =. 
dc 


Then Ta = 0. 
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For, we have f(x+h) =¢ = f(x), whence 


h=0 
dx 
3. 2 =1, 
for imc anit =i, 
h=0 h=OQ h 


The following formulae concern the differentiation of 
a sum, a difference, a product and a quotient of two 
functions y = f(x) and z = g(x), differentiable at a point 2: 


,, Ut) _w& | k alye) dz, dy 


u a h a o ae 
ByE 
6 d(y{z) dz dx 
de 22 
whence 
, a(i) 1 dz : 
6’. ae T (if z #0). 


The proof of Formula 4 follows from the equations 


dy +2) imtholta) + 9(2)) 
dx h 


h=0 


f(z+h)—f (2) 
h 


= lim 


+ lim 
h=0 


hħh=0 


glz +h)—g(x) _ dy , de 
h ~ da ' dz’ 

The proof for the difference is analogous. 

In the proof of Formula 5 we shall apply the con- 


tinuity of the function f at the point x (cf. 1); thus we 
have limf(x+ h) = f(x). Now, 
h=0 


Ay2) im EHA: gle +h) ila): g(a) 
dx h=0 h 


wim LE +1) -9le+ DH +B): 90 


h=0 


+[/ (x +h): g(x)— f(x): g(x)] 
h 
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=i (84-8) lim get ose) +(x): tim Het A) fe) 


dz dy 


=Y ia 
To prove 6, we shall prove first 6’. 
a(1/2) tim th a 
da h= mR glæ+h) g(x) 
=- I to» 9 FMT) _ 1 dz 
limg(a+h) g(2) ro h 2 de 


for lim g(@-+ h) = g(x) = z (moreover, since g(x) Æ 0, there 


ite a 6> 0 such that la # 0 for |hl < ô). 
Formulae 5 and 6’ ea 
d(yjz)_ ajf j\_) a Ldy 1 2 dz 
de ~ da\Y z) TI ae AE z de #\ de ‘dex 
r the first of the above equations we apply the notation 
dF ge). 
dx 


Substituting g(x) = c in formulae 4 and 5 we obtain 
immediately: 
y, Ute) _ 


+p (x) in place of 


5’. 


dx dx” 

The first of these formulae means that a translation 
of a curve, parallel to the Y-axis has no influence on 
the value of the angle between the tangent and the 
X-axis; the second one means that a change of the scale 
on the Y-axis influences the tangens of the considered 
angle in the same proportion. 

Applying Formula 5 and the principle of induction 
we prove easily that for integer exponents n >2 the 
formula 
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It is immediately seen that this formula holds also 
for n = 0 and for n = 1, assuming that if x = 0, then 
in the case n = 0 the right-side of the formula has to 
be replaced by 0 and in the case n = 1, by 1 (as For- 
mulae 2 and 3 show directly). 

This formula remains also true for negative integers n 
(when x + 0). Namely, we have in this case, by 6’ and 7 


d(x”) z( 1 j= 1 d(x”) n 


= — = gTr = ng), 
ax dx \an7* am de gen 


Later we shall generalize formula 7 to arbitrary real 
exponents (for v> 0). 

From the formulae already proved we deduce easily 
the formula for the derivative of a polynomial: 


d 
8. T (aot ax +... + anI”) = a + 20w + 303 + ...4 
+ NA, 2}, 


We shall now calculate the derivatives of the trigono- 
metric functions. 


9 dsinx ae 
. ax —" e 
10. deont = —sing 
dx 
dtanx 1 
11. dæ —s cos’& 


We shall base the proof of formula 9 on the formula 
for the difference of sine known from trigonometry and 
sinh 


on the formula lim —— = 1 proved in § 4.5, (5). Now, 
h=v 


dsinx m2 nt h 
a = lim; [sin (x + h)— sing] = i m > - sing Cos (2+ 3) 


. sin (h/2) (z 3) 
=] -limcos {æ -+ =} = cosg 
bee T Ano "a 


by virtue of the continuity of the function coss. 
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Similarly, 

dcosx —2 h h 
adn = lim; zleos(+h)— cose] = lim >=. sing: sin( + 4 


= — jim——_— am (4/2) -lim sin (2+ 3) = — sine 
S ho (A2) heo i 


According to 6 Formulae 9 and 10 imply Formula 11 


tor we have 
dtanv d/sinz\ 1 cosa RT- sing 2058) 
dx — dx\cosa}/  cos?« dx dx 
=: 2 2 ki 
a (cos x + sin? s) = ET 
dlogse _ dlogax 1 
12. da . More generally, ie = glenn 


Indeed iene to the general properties of loga- 
rithms (§ 5.4, (10) a (11)) we have: 


T 


1 h 1 h\* 
jllog (+h) —logz] = Flog (1+ #) = Ltog|(1 +4). 


Let us substitute yas. Since limy = 0, we have 
h=0 


(cf. § 4, ( )): 


= Žimlog(1 + y. 


L y=0 


gi- 


Moreover, since lim(1+y)¥ =e (cf. § 4, (19)) and since 
y=0 
logz is a continuous function at the point z= e, we 
have (cf. § 5, (6)): 
1 
limlog(1 +y} = loglim(.+y = = loge = 1. 
u=0 
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Thus 


dlogcr ,. 1 1 
= = v+h)—loga] ==. 
T Mig i flog (x + h)—log] 


The second part of Formula 12 follows according to 
Formula 5’ from the first one: 


d oe _ d flogz\ 1 dloge t 
da ©" = Gz \loga ~ loga dx  aloga’ 


Further formulae on differentiation of elementary func- 
tions will be deduced from the general formula on the 
derivative of an inverse function. 


7.3. Differentiation of inverse functions 


Let a differentiable and one-to-one function y = f(x) 
be given in an interval a <r <b. As it is well known 
(§ 5.5, 1 and 2) there exists a function x = g(y) inverse to 
the given one and continuous in the interval f(a) <y < f(b) 
or f(b) < y < f(a), respectively (depending on that whether 
the function f is increasing or decreasing). We shall prove 
that the function g is differentiable in this interval. 


Namely, 
de, dy : dy 
1. a if ape 


Given zx, let us write k = f(x+h)—f(x). Then f(a+h) 
=y+h, ie. +h = g(y +k), whence h = g(y+k)—g(y). 
With variable k, the increment h is a function of k. 


By the continuity of the function g, we have limh = 0; 
k=O 


moreover, we have h + 0 for k #0, since g is one-to- 
one. Applying formula (16) of § 4 we obtain: 


dé, glutk—gly) _ |. h 
ie ee k =" Faja) 


= ieee ee = 
peo f(4@+h)—flae) 


cle- 7 


148 HI. DIFFERENTIAL CALCULUS 


Remarks. (a) As at the ends of the interval of y, 
i.e. at the points f(a) and f(b), one-side derivatives 
exist, then our formula becomes of the following form: 


dx dy 
' =— [= 1: 
4 dys dza’ 
where the signs are the same for increasing functions 
and opposite for decreasing functions. 
For if the function f is increasing, then the function g 
is also increasing and the increments h and k have the 


same sign and consequently, om h= + 0 and lim k = — 9. 
k=—0 

Yet if the function f is decre; then lim h =— 0 
k=+0 


and lim h = +90. 


k=—0 

(8) Geometrically, Theorem 1 may be illustrated as 
follows. 

Let us denote by a the angle between the tangent 
to the curve and the X-axis and by # the angle between 
this tangent and the Y-axis (cf. Fig. 11). Then tanf 
= cota, ie. tanf = 1/tana according to Formula 1. 


(y) Formula 1 exhibits the convenience of the Leibniz 
symbolism: in passing to the inverse function the de- 


: >. & ; : 
rivative = behaves like a fraction. 


Now, we shall give some applications of Formula 1 
in the differentiation of elementary functions. 


de da? 
2 = —— = qt 
2. a = e*, More generally: 2’. at loga. 
Let us write y =e, ie. æ = logy. Since, by 12, 
dz 1 dy dæ _ Sev 2 
T we have —> F = 1: a y. Substituting y = e* we 


obtain Formula 2. 
The proof of Formula 2’is completely analogous. 


darosinv — I 


dx  yl—a 


3. 
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4 dare Cosg ee 1 

l dx yi> 
5 darctang a 1 

‘ dz 14a’ 


To prove 3, let us write y = arcsing, i.e. © = siny. 
Then we have 


a7 cosy = y 1—sin?y = y1—2? 


(where the root has the sign + since —4n<y<}r 
according to the definition of the function arcsin z, cf. § 4.4). 
dy 1 

Hence — = 


dr Yi—x- 


Similarly, writing y = arccosz, i.e. © = cosy, we have 


— = —siny = — Y1—cos’y = — y1—2’, 

~—1 
V1—2- 
Finally, if y = arctang, then x = tany and so 


de i _ oy = EEE OY in E 
u Ose es whence de Ipe 


whence dy = 
dia 


Before we proceed to formulae concerning the super- 
positions of the elementary functions considered above 
we shall prove some general theorems on the derivatives. 


7.4. Extrema of functions. Rolle theorem 


Let a function f be defined in a neighbourhood of 
a point a (i.e. in a certain interval containing this point 
inside). If there exists a ô> 0 such that the inequality 
|h] < ô implies the inequality 


(7) flat+th) < f(a), 


then we say that the function f has a maximum at the point a. 
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Further if the inequality |A| < ô implies 
(8) fla +h) > f(a), 


then we say that the function f has a minimum at the poini a. 

In other words, a point a is a maximum (or a mi- 
nimum) of the function f, if such an interval surrounding 
the point a exists that f(a) is the greatest (or the least) 
among all values of the function f in this interval. 

Replacing the signs < and > in formulae (7) and (8) 
by the signs < and >, we obtain the proper maximum 
and minimum, respectively. 

The maxima and minima have the common name 
extrema. 


EXAMPLES. The function z? has a minimum at the 
point 0; the function sing assumes its maximum and 
minimum values at points being odd multiples of $x, 
alternately. 

As regards the relation between the notion of the 
extremum of a function and the upper and lower bounds 
of this function we note first of all that the notion of 
the extremum is a local notion and the notion of the 
bound of a function is an integral notion: we speak about 
the extremum of a function at a given point and about 
the bound of a function in a given interval. To state 
whether a function has an extremum at a point a it 
suffices to know the values of this function in an arbitrary 
neighbourhood of the point a. On the other hand, to 
find the upper bound of a function in an interval we 
must know the behaviour of this function in the whole 
interval. 

It follows immediately from the definition that 

1. If a function f(x), a<a<b, attains its upper 
bound at a point c lying inside the interval ab (i.e.a< c 
< b), then the function has also a maximum at this point. 


An analogous theorem concerns the lower bound and 
the minimum. 
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Yet if the upper bound of the function is attained 
at one of the ends of the interval ab, then it is not 
a maximum of this function, since the function is not 
defined in any neighbourhood of the ends of this interval. 
E.g. the function y = x considered in the interval 0 <x 
<1 attains its upper bound at the point 1; however, 
this is not a maximum. 

2. If a function f is differentiable at a point c and has 
an extremum at this point, then f'(c) = 0. 

Let us assume the function to possess a maximum 
at the point ¢ (in the case of the minimum, the arguments 
are analogous). Let a number 6> 0 be chosen in such 
a way that the inequality f(¢e+h)—f(c) <0 holds for 
|A| < 6. Thus 

ee for h>0 

„ng Fethi 


i >0 for h<0. 


Since the derivative f'(c) exists by assumption, we have 


fre) = f'(e) = f(e). 
At the same time it follows from the previous inequalities: 
fi(c) <0 <fl(ec). Hence 


fy(e) = 0 = f(e), ie fe) =0. 


Remark. The converse theorem does not hold: the 
equality f’(c) = 0 may be satisfied although the function 
does not possess an extremum at the point c. It is so 
e.g. in the case of the function æ$ at the point 0. 

Geometrically, the existence of an extremum of the 
function f at a point c means (in the case when the 
function is differentiable), that the tangent to the curve 
y = f(x) at the point [c, f(e)] is parallel to the X-axis 
(or is identical with the X-axis). 

3. ROLLE THEOREM. Let the function f be continuous 
in a closed interval a <a <b and differentiable inside this 
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interval. If f(a) = f(b), then a c exists such that a < c < b 
and f'(e) = 0. 


Indeed, if the function f is constant, then we have 
f'(<) = 0 for every x lying between a and b; hence, in 
this case we may take any value of x as c. 

Thus, let us assume that the function f is not constant 
everywhere, e.g. let us assume that f has values > f(a). 
Denoting by M the upper bound of this function, we 
have then M > f(a). According to the Weierstrass theorem 
(§ 5.4, 2) there exists a ¢ in the interval ab such that 
f(c) = M. Moreover, a + c # b, since f(a) = f(b) by as- 
sumption. Thus a < ¢ < b. This means that the function f 
attains its upper bound at a point c lying inside the 
interval ab; according to Theorem 1, the function f 
possesses at this point a maximum, and by Theorem 2, 
we have f’(c) = 0. 

Rolle theorem is easily understood geometrically: 
if a curve (having a tangent at every point) crosses the 
X-axis in two points, then at a certain point the tangent 
to this curve is parallel to the X-axis. 


Remark. Rolle theorem may be expressed also in 
the following form: if f(x)=/f(#-+h), then a O exists 
such that 


(9) f(#+O0h)=0, 0<0<1; 


here the same assumptions on the continuity and the 
differentiability of f(x) are made as in Rolle theorem 
(yet we do not assume that h > 0 but only that h Æ 0). 


7.5. Lagrange (') and Cauchy theorems 


Let us assume as in the Rolle theorem that the func- 
tion f is continuous in the interval a<a<b and dif- 
ferentiable inside this interval. Then we have the 


() Joseph Louis Lagrange (1736-1813), the most eminent ma- 
thematician of the 18th century, one of the authors of the theory 
of differential equations. 
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(Lagrange) mean-value theorem (called also the theorem of 
“finite increments”): 
b a 
TORCE 
where h = b—a and @ is a suitably chosen number such 
that 0< O<1. 

Before proceeding to the proof we interpret the above 
formula geometrically. Its left side means the tangent 
of the angle a between the X-axis and the straight line 
joining the points [a, f (ayj and [b, f(b)]. Hence the theorem 


LZ 


Fig. 13 


states that there exists a tangent to the curve which is 
parallel to this straight line (the “secant to the curve”). 
A special case gives Rolle theorem, namely, when this 
secant is parallel to the X-axis. We shall reduce the 
proof of the Lagrange theorem to this theorem. 

Let us draw a straight line parallel to the Y-axis 
through an arbitrary point x lying between a and b 
(cf. Fig. 13) and let us denote by g(x) the length of the 
segment of this straight line contained between the curve 
and the above defined secant. Thus the length of the 
segment contained between the X-axis and the secant is 
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g(x)+f(z). On the other hand, this length is f(a)+ 
+(x—a)tana, whence 


(10) gla) = f(a)— f(a) + w- a O, 


The function g satisfies the assumptions of Rolle 
theorem. It is continuous in the interval a <z < b, 
differentiable: 


gia) = —7'(2) 4 OH), 


and g(a) = 0 = g(b). Hence the function g'(x) vanishes at 
a certain point between a and b. In other words, a © 
exists such that 0< © < 1 and that 


g’(a+Oh)=0, ie. O= -f(a + on) LOH) = 

So we have obtained Formula 1. 

Remarks. («) The geometrical considerations have 
been only of a heuristic character here; they make clear 
why the function g is introduced. However, the proof 
of the Lagrange theorem might begin with the definition 
of the function g by means of the formula (10). 

(B) Analogously to the formula (9), the equation 1 
may be also written in the following form: 


(11) f(e+h) =f(x)+h-f'(x+ Oh). 


Lagrange theorem implies the following two corol- 
laries, being of fundamental importance in the integral 
calculus. 

3. If f'(w) = 0 for every x lying inside the interval ab, 
then the function f has a constant value in this interval. 

For, according to (11) we have f(#+h) = f(x) for any x 
and h and this means that f is of a constant value. 

4. If we have f'(x)= g(s) for all a<ax<b, then 
j(x) = g(#)+ constans, i.e. the functions f and g differ 
by a constant. 
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Indeed, [f(x)—g(zx)]’ = f'(x)—g'(x) = 0 and this means 
that the function f(æ)—g(x) has the derivative = 0 
everywhere. Hence, by Theorem 3, this function is con- 
stant. Writing f(«)—g(r) = C we have f(x) = g(x)+C. 


Remark. Making in Theorem 3 the additional as- 
sumption that the function f is continuous in the whole 
interval a < x < b, this function is of constant value also 
in this whole interval. Namely, we may substitute x = a 
in the proof. 

A similar remark concerns Theorem 4. 

Lagrange theorem may be generalized as follows: 


5. CAUCHY THEOREM. If the functions f and f, are 
continuous in the whole interval a <x <b and differentiable 
inside this interval and if filz) #0 for any x, then 


f(b) — fla) fila + Oh)’ 


where h = b— a. 


0<0<i1, 


Lagrange theorem is obtained from Cauchy theorem 
by making the substitution f(x) = x. Conversely, to prove 
Cauchy theorem let us replace the function g(x) in the 
formula (10) by the following function: 


f(b)— f(a) 
f(b) — Ala) ` 


(Let us note that f(b) + f(a) according to the assumption 
fi(z) #0 and Rolle theorem.) 

This function satisfies the assumption of Rolle 
theorem: 


g(x) = f(a)— f(x) +[fi(r)—-hle)is-5— 


7 4(b)— ila) cies 

(13) g(x) a f(x x) + fi(x) f,(b) — fla) ha 3 g(a) oo 0 = gi(b) . 
Thus there exists a © between 0 and 1 such that 
g'(a+ Oh) = 0. Substituting x = a + Oh in the formula (13), 
we obtain equation (12). 
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Analogously to the formulae (9) and (11) we obtain 
from Cauchy theorem: 


f(w+h)—f(a) _ fle + Oh) 
hlæ+h)— hlæ)  file+ Oh)’ 

Remark. It is essential in the Cauchy formula that 
© indicates the same number in the numerator and in 
the denominator. A direct application of Formula 1 to 
the function f and to the function f, and the consideration 
of the quotient of the obtained expressions leads (in 
most cases) to different numbers 9 in the numerator and 
in the denominator. 


(14) 


7.6. Differentiation of composite functions 


Let y = f(x), z = g(y), where the function g is defined 
for the values y of the function f, the functions f and g 
are differentiable and the derivative g’ is continuous. 
The following formula gives the derivative of the com- 
posite function g[f(x)] in terms of the derivatives f’ and g’. 

HY ioe) Wer few) ae) 
dx dy dx’ oe dx dy y=F(a) dx ` 

Given x and h #0, let us write k = f(z+h)—f(z), 
i.o. f(exth) =y+k. 

Applying the formula (11) on the mean-value to the 
function g we obtain: 

meth gf (a) _ auan g(y) = 9(y +k) $ 


To get Formula 1 we have to pass to the limit 
as h tends to 0. Now, by virtue of the continuity of 
the function g we have limk = 0. Since 0< © < 1, this 


h=0 
also implies lim Ok = 0 (let us note that © is also a func- 
h=0 
tion of the variable h). Thus lim(y+ Ok) = y, which 
h=0 


() For brevity, we write g/(x) instead of g{f(zx)]. 
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gives limg’(y+ Ok) = g'(y) = g’[f(a)] according to the 
h=o 
continuity of the function g’. Consequently, 


dgf(x) _ 5. gf(x + h) -gf (x) 
a es h 
eer . eth 
=limg'y + Ok)im ETON) L g'ij{a)]: f(a). 

h=0 h=0 

Remark. The theorem is also true without the as- 
sumption of the continuity of the function g’. However, 
then it requires another more complicated proof. 


Applications. Formula 1 enables us to generalize 
Formula 7 of § 7.2 in the following way: for any real a 
and any positive x, we have 

dx 


a =a ani 
2. Tz a- ye}, 


Namely, we have a = et and so substituting 


z= & and y =a-loga we find 
dxe _ dev d(aloge) a aa a 
a d dae CO a ee 


The above calculation could be written also in the 
following way: 


axe dertex = d(a-logz) ee Lode = 2 
d daoen de OOT T 
dx? 
3. ae = a(logx+1), 
for 


dat deles: qels: d(x. Jog) 


z de — dæ- logsz) do 
= elger (logr +1) = a(logr+1). 


lax 
Let us note that formula 2 of § 7.3, T = aloga, 


proved previously, could be proved in an analogous way, 
because a? = etre, 
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In practice we sometimes apply Formula 1 several 
times; e.g. if y = f(x), z = g(y), w = h(z), we calculate 


ah {gC f(x)]} 
dx 


the derivative , applying the equality: 


BOO ae Gy 
dx dz dy dx’ 

As seen, the derivatives in the above formula behave 
like ordinary fractions. 

4 Bogia) _ fla) 

dae f(a)” 

This expression is called the logarithmic derivative of 
the function f. A knowledge of the logarithmic derivative 
gives the usual derivative at once. This is easy to show 
by considering the example of the function y = q” (where 
the logy = zlog~ is differentiated). 


EXAMPLES. 
(a) dlogsin(x?) _ dlogsin(2*) dsin (2?) da? 
dx ~ dsin (22) dx dr 


= sin (a2) 
(8) The derivatives of the hyperbolic functions. By the 
hyperbolic sine and cosine we understand the functions 


ee? et +e? 
3 and coshr = —;5— . 
— ad 


Cos (x?) 22 = 2xcot (x). 


(15) sinha = 


To find their derivatives let us note that 
de-= — de? d(—x) _ 


— ae et 
dx d(—z) dr 
Hence we find easily: 
dsinhx dcoshx 
(16) ds = cosh, ds = sinha 


Now let us write 


sinhr _ e —e~* 
(17) tanhs = osho = epe” . 
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Since, as it is easily seen, 


(18) cosh? v — sinh? e = 1, 
we have 
sinh g 
(19) dtanhz coshy  cosh?x—sinh?s 1 
dx dx cosh? y — cosh? ` 


The functions sinhg and coshz have inverse functions. 


-z 


Namely, let y = = . Then e*—e-* — 2y = 0, i.e. e” — 


— 2ye? — 1 = 0, whence 


e =y+yVy+1, Le. x = log (y+ Vy? +1) 


Me 


Fic. 14 Fig. 15 Fic. 16 


(the value y—y 4? +1 being negative, we do not take it 
into account). In this way we have expressed x as a func- 
tion of y. This is the required function inverse to sinhz. 
We denote this function by the symbol arsinh: 


(20) ar sinha = log (£ + ya +1). 


Similarly, we find the function inverse to cosh% 
(x > 0). This function is denoted by the symbol arcosh. 
We find 


(21) arcoshe = log(a+Yya?—1), «>1. 
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Analogously, a function inverse to cosh (æ < 0) is 
log(#—ya*—1), £> 1. 

Appiying the formulae (16) and the formula on the 
derivative of the inverse function we find easily that 


dar sinh g 1 d 
22 —— = = —] y 

d shoes 
(23) ples EEE E OTF 2 


dx +y2-1 de 


This calculation may be performed also by differ- 
entiation of functions on the right sides of the formulae (22) 
and (23). 


AW 


Fie. 17 Fie. 18 Fic. 19 


We add that the following formula is found for the 
function inverse to tanha: 


(24) “artanha = zlog EE, jej <i. 
Hence 

dartanh z 1 = afl 1+2 
ee) da -z7 Bl; ogy 


Remark. The formulae on the differentiation of the 
fundamental functions with which we became acquainted 
in §§ 7.2 and 7.3 together with the formula for the dif- 
ferentiation of composite functions make it possible for 
us to differentiate an arbitrary elementary function (that 
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is a function obtained from the fundamental functions 
by applying of an arbitrary number of compositions). 
A derivative of an elementary function is itself an ele- 
mentary function. 

Now let us consider the following function (non- 
elementary): 


(26) f(a) = a. sin $ for SEO, f(0)=0. 


The general formulae for the differentiation of the 
elementary functions do not enable us to calculate f'(0). 
We must calculate this derivative directly from the 
definition of a derivative. 

We have 


#'(0) = tim LO 10) NO iiesins =O: 
h=0 h=o h 

It is clear that for x # 0 the derivative /’(7) may be 

calculated by means of general formulae concerning the 
differentiation of the elementary functions. 


7.7. Geometrical interpretation of the sign of a derivative 


Lagrange’s theorem enables us to establish the relation 
between the sign of the derivative and the increase or 
decrease of the function. 

1. If the inequality f'(x) > 0 holds for any x belonging 
to an interval ab, then the function f is increasing in this 
interval. 

If f'(@) < 0 everywhere, then the function is decreasing. 

According to the formula (11) we have for k> 0, 
f(æ +h) > f(x) or f(x+h) < f(x), depending on whether we 
assume the derivative to be positive or negative every- 
where. In the first case the function f increases and in 
the second one, decreases. 

Remark. Assuming f'(x) > 0 or f'(x) < 0 everywhere, 
the function f is increasing in the wider sense or de- 
creasing in the wider sense, respectively. 
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The following theorem is the converse to Theorem 1: 


2. If a function f is differentiable at a point c and 
increases (or decreases) in a certain interval surrounding 
this point, then f’(e) >0 (or f(e) <0). 


Namely, if f increases, then for h > 0 we have f(e+h)— 


f(e h)— tle) 
h 


—f(¢)> 0 and so > 0 and passing to the 


limit we obtain f'(¢) > 0. 

Similar arguments can be applied in the case in which 
the function f decreases. 

We conclude from Theorem 1 that 


3. If fe) > 0, then the function f is increasing im 
a certain neighbourhood of the point c (assuming the de- 
rivative to be continuous at the point c). 


Similarly: if f'(c)< 0, then the function is locally 
decreasing at the point c. 


Indeed, because of the continuity of the function 
f the inequality /(¢) > 0 implies the existence of 
a number 6> 0 such that there holds f’(¢+h)> 0 for 
|h] < 6. This means that the derivative f'(x) is positive 
at any point of the interval e—h<a«<c+h. Thus, ac- 
cording to Theorem 1 the function f is increasing in this 
interval. 


Remark. Theorem 3 may be expressed in the follow- 
ing way: if f(c) 4 0, then (assuming the continuity of 
the derivative) the function f is locally one-to-one at 
the point ¢, i.e. it is one-to-one in a certain interval 
c-d<“2<c¢+6 (6>0). Thus, the function y = f(x) 
possesses the inverse function x = g(y) in this interval. 
As we already know, the derivative of this inverse func- 
tion is equal to the inversion of the derivative of the 
function f. 

By the above assumptions we see that for a given 
value of y the equation y = f(x) possesses one and only 
one solution for x belonging to the interval c—ô, ¢+ 6. 
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r g7 
EXAMPLE. The function y = z decreases for 0<%<1 


and increases for æ > 1. 
Indeed, 


d (e\  vet—e* _— e*(x—-1) 
dx \x i 
This expression is <0 if z< 1 and >0 if ¢v>1. 


Hence it follows that lim Pin oo, Indeed, lim — = œ 


t=O T n=0 


(cf. § 3.5, 7) and so the function z, being unbounded 


and increasing, tends to co as œ tends to oo (we have 
obtained this result in another way in § 4.6, (B)). 

More generally, we prove in a completely analogous 
way that the function f(x) = ea* («> 0) is decreasing 
for x < —a (and a< 0) and increasing for «> —a and, 
since lim e"n = oo (cf. § 3.5, 7), 


TL == 00 


(27) lim ea = co. 


r=CO 


7.8. Indeterminate expressions 


Cauchy’s theorem in § 7.5 makes it possible to cal- 
culate the limit of the following form: 


f(x) 
2 li 
(a8) zza J(T) 


Expressions of this kind are called ‘indeterminate 
expressions of the type %”’. 


where f(a) =0 = g(a). 


1. If the functions f and g are continuous in the closed 
interval a < x < b and are differentiable inside this interval 
and if f(a) = 0 = g(a), then 


(29) lim LE = lim L@) 


z=a+0 g(x) z=a+0 g'(x) ; 


assuming the existence of the last limit. 
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Let us write x = a +h. Then it has to be proved that 
n Lath), f(a+h) 
30 lim = lim ~. 
(80) teoga FA) nao gla Fh) 
Now, the equations f(a) = 0 = g(a) and the Cauchy 
formula give 
flah) _ f(athk)—f(a) _ flat Oh) 
glath) gla+h)—gla) g(a- Oh)’ 
Since lim Oh = +0, we have 


h=+0 


. f'(a+Oh) — f'(ath) 
SS oR = l oy aa Et 
nagog la+ Oh) per0g lath)’ 


whence the formula (30) follows. 
A similar theorem concerns the left-side limit. 
When the derivatives 7’ and g’ are continuous at the 
points a and g’(a) + 0, formula (29) implies immediately 
the following de l’Hospital (1) formula: 


f(a) _ f(a) 
(31) him (a) g(a)” 


A similar formula concerns the one-side limit and the 
one-side derivatives. 


_ EXAMPLES. (~) To find lim PEt 


z=0 


let us write 


f(x) = log(1 +x) and g(x%)=2. 


Hence 
f 1 + d 
{(0) =0 =g(0), V2) = Fay? g(x) =1, 7(0) =1 
and so 
(32) in SECTA ny, 
z=0 x 


(¢) De Hospital, a French mathematician of the second half 
of the 17th century, known especially for popularizing the dif- 
ferential calculus. 
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(8) Evaluate lim a . Let us write f(x) = e*—1 and 


z=0 
y(z)= @ Then we have /(0)=0=4g9(0), f(x) =@&, 
g'(w) = 1. Hence 


(33) iim? = oO 


=), 
z=0 T g g (0) 


Remarks. (a) If g'(a)=0 but f’(a) 40, then the 
formula (31) gives im D te = 0. But if f'(a) = 0 = g’(a), 
then the formula (31) cannot be applied. In this case 
the derivatives of higher orders have to be applied. 
(Cf. § 8.4.) 


(8) The formula (29) may be applied also in the case 
when a = oo. In other words, if lim f(x) = 0 = lim g(x), 


gz=00 
then 


f(x) f2) 
(34) T =li g g'(x)’ 


assuming the existence of the last limit. 


We write z= > and define an auxiliary function F(t) 
by the conditions: F(t) = s(a) for t#0 and F(0)=0. 


Similarly, let G(t) = a(;) fort 40 and G(0)=0. The 
function F is continuous at any t #0 as a composition 
of two continuous functions: and f. It is also right-side 


t 
continuous at the point 0, since (cf. § 4, (18)) 


lim F(t) = tim j(; i) = lim f(x) = 0 = F(0). 


t=+0 


Similarly, the function G is continuous. To be able 


to apply the formula (29), jim. 0) 
t 


-—- has to be calculated. 
-+0 @'(t) 
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Now, we have 


ary 4 G) djl) de_ Ly () 


a ü da a 
for t #0. Similarly, G(t) = — ao G) Thus, 
r 


oo f(%) i=40 Bia ~ t= ae way E 9 ( z=% J'(@) ` 


; ; f 0. 
Besides indeterminate expressions of the form g im 


. . oO 
determinate expressions of the form — are also con- 
oo 
sidered. By such an expression we understand 
lim——, where lim/(z) =co=limg(a). 
rea 9(Z) z=a z=a 
Sometimes the calculation of aint expressions 


of this form may be reduced to the form ? . For, writing 


0° 
1 1 
F(x) =i and G(x) = Ja we have 
fle) _ |, Gla) 
ma g(r) sea B(@)’ 


and this last indeterminate expression is of the form 
Similarly, if lim/f(z) = 0 and limg(x)= oo, then the 
t=4a r= 


indeterminate expression lim/(x)-g(x) of the form Q- oo 
z=a 


may be reduced to the form _ for 


wen) g(@) = mn no ; 
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If Bane) = o0 Som g(x), then we reduce the in- 


determinate expression ‘lim [f (£)— g(x)] of the form co — co 


also to the form - writing 
3 G(x)— F(x) 
l — = DNA 
e 9 | == lan F(x) Ga) ° 

It remains to consider indeterminate expressions of 
the form 0°, oof and 1%. They may be reduced to the 
above considered by means of the relations 


` 7 . lim g(x) + log f(x) 
lim f(ay™ = lim ef log f(z) nea 


zr=a zZ=a 
EXAMPLES. 
1 Pe | 
log cosz lim -logcosz 
(y) lim (cosa)? = lim e = ge=+0% ant 
z=+0 r= +0 
because 
. logcosx ,.  (logcose _ — tan 
fin OO ON oyim OE ORS) g - lim =i 
t= +0 £ z=+0 tato 1 


(8) Find the right-side derivative f41.(0) of the func- 
tion f defined as follows: f(x) = a when x> 0, f(0)=1. 
We have 


f4 (0) = lim TO= O) = lim ee 
$ hm -4-0 h A=+0 i 


This is an expression of the form z? for lim a4 = 1 
z=+0 
(§ 5.3). Applying formula (29) and taking into account 


the fact naa (a — 1) = a*(loga +1) (cf. § 7.6, 3) we obtain 
lim ——— = lim ee eee 

PORE I A z=+0 V (logs +1) 
whence f4(0) =—oo. 


—0, 


(£) The expression lim (xlog2) is an indeterminate form 
0 


z=+ 
of the type 0-oo. The proof that this limit-is equal to 0 
may be derived directly, without applying of the dif- 
ferential calculus (cf. § 4.6, (3)). 
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7.9. The derivative of a limit 


THEOREM. If the equalities 

(35) lim f(a) = f(z) and lim f(a) = g(2) 
n=00 n=00 
are satisfied in the interval a < x < b, the functions fn being 
continuous and uniformly convergent to g, then 
PONER tg oe ya dhala) 

(36) f'(%)=g(x), te. dy Sm halo) oe a 

Let ¢ be a given point of the interval ab. Let us 
estimate the difference 


fale +h) — fale) 
h 


(37) —g (e) = fale + Oh) -g (c). 


Let £ > 0 be given. Since the sequence {fn} is uniformly 
convergent to g, there exists a k such that 


(38) [fn{w) — g(@)| < € 
for n > k and for any x belonging to the interval ab. 
The function g being continuous as the limit of a uni- 
formly convergent sequence of continuous functions 
(cf. §6.1, 1), a number > 0 exists such that the in- 
equality |a—c| < ô implies 
(39) |g(a)—g(e)| < e. 
Thus, assuming n>k and {h|<6 we obtain the 
following estimate: 
fale + Ohk)— g(6)| < |fale + Oh)— g(c + Oh)|+ 
+|g(c + Oh)—g(c)| < 2e, 
i.e., by (37), 


(no FM Il) g(e) <2e. 


Since 
lim fale +h) =f(e+h) and limfa(e) = f(6), 
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we have 


He MNO) gi] cae, 
if only |h| < 6. Passing to the limit as h tends to 0 we 
therefore obtain equation (36). 

Remarks. («) Even the uniform convergence of a se- 
quence of functions does not imply the convergence of 
the sequence of derivatives, as is shown by the following 
example: 


É 
fala) = znne. 


(8) The theorem remains true if we assume that the 
first of the equations (35) is satisfied at a given point c 
instead of assuming it to be satisfied in the whole in- 
terval ab. For, if the sequence of functions is convergent 
at a point c and if the sequence of the derivatives is 
uniformly convergent in the whole interval ab, then the 
sequence of functions is convergent in the whole in- 
terval ab. 

Indeed, according to our assumptions, to a prescribed 
e> 0 there exists a number k such that the inequalities 


(40) |fn(e)—fx(e)]<e and = |fa(a)—fi(a)| < e 


are satisfied for n>k and a <z <b. 
Let us write F,(x) = fr(v)—f,(2) and «=c+h. Then 
we have 


Fal) = Fp(c) +h- Fale + Oh) 
= fn(e)— fele) + AT fale + Oh) —fi(e + Oh)}. 
Hence, by (40), we have |F,(x)|<e+(b—a)e=e(1+b—a). 
Thus the sequence fn(x) is convergent. 
7.10. The derivative of a power series 
We shall prove that 


d 
(41) Gy Ot hT aat...) = Q, + 2a £ + 34,27 +... 
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for any x lying within the interval of convergence of the series 
(42) }(@) = aot l£ + tat +.. 

Moreover, the series (42) and 

(43) g(x) = a, + 2a, £ -+3432 +... 


have the same radius of convergence. 


We shall first prove the second part of the theorem. 
Let r be the radius of convergence of the series (42) and 
let 0< ce<r. We shall prove the series g(c) to be con- 
vergent. Let c< C<r. Let us compare the terms of 
the series 


(44) Ja] +2lale +... + nlan e 4... 


with the corresponding terms of the convergent series 
(cf. § 6.3, Theorem 1): 


(45) ja lC+l]a| 0 +.. tjan C.. 
Since lim /n = 1 (ef. § 3.5, 8) and . > 1, we have 
N= OO 
ae 
) c 
and thus 
[an| > pn eg ” l jo 
m—-1 i. L —f—. = — 
njanje = > (Vne < E P 7 lanl C 
for large n. 


Hence we conclude that the series (44) is convergent 
and so the series g(c) is absolutely convergent, too. 

Conversely, if the series (43) is absolutely convergent, 
then the series (42) is also convergent. Namely, 


jana"| = |æ|- [anat] < |æ]: [nana] 


In this way we have proved that any point lying 
within the interval of convergence of the series (42) 
belongs to the interval of convergence of the series (43) 
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and conversely: any point lying within the interval of 
convergence of the series (43) belongs to the interval of 
convergence of the series (42). Thus, both these intervals 
are equal. 

Now, let us proceed to the proof of formula (41). 
Let x be an interior point of the interval of convergence 
of the series (42) and thus of the series (43), too. Let 
the interval ab be any closed interval surrounding this 
point and lying inside the interval "of convergence. By 
Theorem 1 of §6.3 the series (43) is uniformly con- 
vergent in the interval ab. This means that when we write 


Tr(v) = +4,274+...+a,2%, 


the functions f, constitute a sequence uniformly con- 
vergent to the function g in the interval ab. Applying 
the theorem of the previous section we obtain the for- 
mula (41). 

As is easily seen, formula (41) states that a power 
series can be differentiated, term by term, like a polynomial. 


More generally, if by differentiating the series X Un(2) 
n=0 
term by term we obtain the series > u(x) uniformly 
n=O 


convergent and if, moreover, the functions w(x) are 
continuous, then 


(46) £ D u,(@) = oy Urla). 
n=0 n=0 


EXAMPLE. Differentiating the series 


1 
—— = l y2 an 
nar Ll+as+a'?+...+4a"+... 


we obtain for x| <1: 


1 
(Gv? = 1 + 2g + 3L +... H na" +... 
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7.11. The expansion of the functions log(1-+ 7) and arctanz 
in power series 


Let us consider the known formula 


dlog(l+a) 1 


(47) Sygate. (ae 1): 


dx 1+2 
It is obvious that the series appearing in this formula is 
the derivative of the series S(x) = «— a + aa + = 


Hence the functions log(1+ 2) and S(x) have the same 
derivative and so they differ only by a constant (cf. § 7.5, 4). 
Let us write log(1 +s) = S(z)+C. The constant © may 
be calculated by substituting z = 0; we obtain log(1+0) 
= 0 = 8(0). Hence C = log(i+0)—S(0) = 0. 

So we have proved the functions log(1+ æ) and S(z) 
to be identical in the interval —1 < æ< 1. Speaking 
otherwise: 

a2 Ë æ 
ear 


(48) log(L +a) =2- 5 +5 — Ha (la] <1). 


4 T 


Similarly, we deduce from the formula 


darctang 1 2 6 
=“ ag Apeere (e| <1) 
that 
Be x 
arctang = 0+2- zt gT 


Substituting s=0 and taking into account that 

arctan0 = 0, we obtain C = 0. Consequently, 

se 
5 7 
~ Thus, we have proved that the formula (48) holds 

for jæ| <1. We shall show that it holds also for x = 1. 
Indeed, for «= 1 the series on the right side of this 


formula, i.e. the series S(1) = 1~4+4-..., is convergent 
and thus by the Abel theorem (§ 6.3, 3) the function S (æ) 


(49) arcetang = g— a 


zt 


+.. (læļ <1). 


7. DERIVATIVES OF THE FIRST ORDER 173 


is left-side continuous at the point 1. Hence 
S(1) = lim 8(x) = a pel +2) = log2, 


r=1—0 
since the function log(1+ 2%) is continuous at the point 1. 
Consequently, 


(50) log2 =1—4+4—-{+4-... 


Similarly, we deduce from formula (49) the Leibniz 
formula: 


T 1,1 1 1 
on) gi gta ate 
Denoting the right side of the equation (49) by T(x) 
we have 


T(1) = lim T(x) = lim arctanz = arctanl = 2 
z=1—0 z=1-0 4 


whence formula (51) follows. 


Remarks. («) In practice the Leibniz formula is not 
convenient for the calculation of the number 7; e.g. to 
calculate the first three decimals of the number 7/4 it 
would be necessary to take the sum of the first 500 terms 
of the Leibniz expansion. Much more convenient is the 
following formula. 

Let a = arctan}, f = arctan}, i.e. tana = 4, tang 
= 4. Since 

tana -+ tan f 4+4 nai 
1—tana- tang ie Er 
and 1 = arctan (7/4), so 7/4 = a+ 8 = arctan $ + arctan ġ. 
Hence, by formula (49), we obtain: 

z 1 1 1 1 1 1 

4-2 3-8°5.98 0 t3 327 1 5-243 

Other formulae giving even faster methods for the 
calculation of v are known. 


(8) The formula (48) leads to the following inequality: 


tan(a +f) = 


(52) “log(1+2) <1 for O<@#<l. 


174 Il. DIFFERENTIAL CALCULUS 


For, we have 


ce I ae 
(53) Tlog(1 +a) = 1—5 +S. F 


For 0< x <1 this is an alternating series satisfying 
the conditions 
oll >.. and lim2 = 0; 
3 n 


ues 
thus, according to the theorem § 3.3, the sum of this 
series is less than its first term, i. e. the inequality (52) 
holds. 


Similarly we prove that 
l1 1 ; ? 


since adding to the series (53) the series (48) divided 
by 2, we obtain 


(+ 3) log(1 +x) 


i ay. ai pou 
i } A EGEE N r = 
Sapte G 3- a({- PES ete ( n+. A To 


It is easily seen that by omitting the first term we obtain 
an alternating series satisfying the assumptions of Theo- 
rem 1 of § 3.3. Hence we conclude that the sum of this 
series is positive. Thus, formula (54) holds. 


7.12*. Asymptotes 


By applying the differential calculus it is possible to 
find the asymptotes of a given curve y = f(x). The straight 
line Y=aX-+b is called an asymptote of the curve 
y =f (2), if 

a = lim f'(x) and b=lim[f(x)—ar]; 
g=0 g=% $ 
hence it is seen that the direction of an asymptote is 
a limiting direction to which the direction of the tangent 
to the curve at the point [a, f(x)] tends, as x tends to oo; 
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moreover, the distance between this point and the asymp- 
tote tends to 0, because this distance is equal to |[f(#)— 
—ax—bjcosa|, where a is the angle between the asymp- 
tote and the X-axis. 
Similarly we consider asymptotes for x tending to — oo. 
Finally, the straight line X = ¢ (parallel to the Y-axis) 
is called an asymptote of the curve y = f(%), £< c, if 


lim f(x) = +oo= lim f(z). Similarly we define the 
z=c—0 z=¢—0 


asymptotes to the curve y = f(x), >c. 


Fic. 20 


EXAMPLES. As it is easily seen, the asymptotes of the 
hyperbola y = 1/x are the axes X and FY. 
To find the asymptotes of the curve y = e717, we 
a 
calculate y’ = —-. Hence lim y = 1 and lim y’ = 0. Thus, 


> T00 t=% 
a = 0 and b = 1, and the straight line Y = 1 is an asymp- 


tote. A second asymptote is the Y-axis, because lim y = co 
xr=—-0 
and lim y’ = œ. 
t=—0 


7.13*. The concept of a differential 


A rigorous mathematical sense may be given to the 
concept of a differential in the following way. By the 
differential of a function y = f(x) at a point œ with 
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regard to the increment h we understand the product 
f'(a)h. We write 


(55) df(x) =f'(2)h or, more briefly, dy =/'(x)h. 


The symbol df(x) or dy, convenient in applications for 
its simplicity, takes into account neither the dependence 
of the differential on the variable 2 with respect to which 
the differentiation is performed, nor the dependence on 
the increment h. To satisfy these requirements we should 
have to write e.g. d;(y,h). Moreover, if we should like 
to point out that the differential is considered at a point x, 
we should have to write [dz(f(x), h)|--z, by analogy with 
the notation for the derivative at a point zy. 

By formula (55), dæ = h, for substituting f(a) = <£ 
we have f(z) =1. 

Thus we may substitute in the formula (55) h = dz. 
We obtain dy = f'(x)dz. Dividing both sides of this 
equation by dx we have then 


ray =, 


where the right side is the quotient of two differentiais 
(which may be considered as an explanation of the 
Leibniz notation for the derivatives). Speaking more 
dz(y, h) 
d(x, h) 
formulae of the differential calculus may be written in 
the differential notation as is seen by the following 
examples: 


strictly, we have f'(x) = for every h #0. The 


de*=edx, dsinx=cosxdr, de=0. 


Formula 4 of § 7.4 for the derivative of a sum leads 
to an analogous formula for the differential of a sum: 


(56) d(y +2) = dy+dz. 
Indeed, let y = f(x), z = g(x). We have 
d(y +z) =(yte2)h=yh+oh = dy +dz. 
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Analogously, we prove that 
(57) d(yz) = ydz--z2dy. 


Now we shall give the formula for the differential 
of a composition of functions. 
Let y = f(x) and z = g(y). Then 


(58) dzz = gy) dey . 


Namely, d2 = cone) dx = g'(y)f'(x)dx = g’(y)dzy, ac- 


cording to (55). 


dy 


z dæ æ+h 


Fic. 21 


Let us note that by (55) we have also dyz = g'(y)dyy. 
Comparing this equation with equation (58) we see that 
if z is a function of the variable y, then the formula for 
the differential z remains formally unchanged after re- 
presenting y as a function of a new variable x (however, 
the index at d showing with respect to which variable 
one has to differentiate has to be obviously omitted). 

The geometrical interpretation of the differential is 
immediately seen in Fig. 21. 

The following theorem holds: The difference between 
the increment of the function Ay = f(a-+h)—f(x) and the 
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differential dy, divided by the differential dx tends to 0 
together with this differential, i.e. 


(59) lim SY = 6. 
Namely, 

Ay ay _ Heth- FOIA _ iet- yyy, 
da h 

and 


tim (2+ M—He) _ 


h=0 h 


F(z). 
In practice (e.g. in physical applications) the above 


theorem often makes it possible to replace the differential 
dy by the increment Ay. 


Exercises on § 7 


1. Differentiate the following functions: 


1) s +204 ; 2) W2a—a5, 3) 


gt—1 rae 
4) seca, 5) cosecex , 6) cotanz, 
7) arcsecr , 8) arccosecz , 9) arccotanz, 
10) logsinz, 11) logtanz , 12) arccos(1— £s), 
13) arctan y 14) logsinha, 15) artanh Va. 


2. Prove that if a function f is differentiable, then 
its derivative f’ possesses the Darboux property (i.e. passes 
from one value to another through all the intermediate 
values). 

(First prove that if f'(a)< 0 < f'(b), then a point ¢ 
exists in the interval ab such that f'(c) = 0. The general 
case when f'(a) < A < f'(b) may be easily reduced to the 
previous one considering the function {(x)— Az.) 
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fo a) +1 
3. Given the series f(x) = 2 -2h find f'(x) 
and the sum of the series of the derivatives. Compare 


the result obtained with the theorem in § 7.9. 

4. Prove that if a function f is differentiable at 

a point x, then 
; -~ F(æ +h)—f(æ—h) 
a 

Show by an example that the converse relation does 
not hold: the above limit (i.e. the so called generalized 
derivative) may exist although the function is not dif- 
ferentiable at the point z. 

5. Give an example of a function having a generalized 
derivative at a point of discontinuity. 

6. Give an example of an even function (i. e. such 
that f(x) = f (—x)) for which f’(0) = 0, although the func- 
tion does not possess an extremum (even an improper) 
at the point 0. 

7. Prove that if a continuous function possesses 
maxima at the points a and b, then it possesses also 
a minimum at a certain point between a and b. 

8. Let a function f be continuous in an interval 
a<xa<b and differentiable inside this interval. If the 
right-side limit lim f'(x) exists, then the right-side de- 


xr=at+0 
rivative of the function f exists, too, and they are both 
equal: f(a) = lim f'(x). 
r==a+0 


9. Prove that among all rectangles with the same 
perimeter the square has the greatest area. 

10. Prove that among all triangles with a constant 
perimeter and with a constant base the isosceles triangle 
has the greatest area. 

11. Prove that among all triangles with a constant 
perimeter the equilateral triangle has the greatest area. 

12. Prove that if the derivative f’ is strictly monotone, 
then for any x, the curve y = f(x) lies on one side of 
the tangent at this point. 
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Hence conclude that e*>1+4+2 for x <0. 
13. Prove that (Gajas +æ)<1 for 0<zrsl. 


14. Prove that zais <log(1+<2) <a for v> -—i. 


15. Expand log V = in a power series. 


16. Given two points P and Q ‘lying on the plane 
above the X-axis, find a point R on the X-axis such 
that the sum of the segments PR and RQ is the shortest 
possible. Prove that the (acute) angles between these 
segments and the X-axis are equal. 

(Interpret this result in the theory of optics: PRQ 
= the path of the ray, the X-axis = the mirror). 

17. Evaluate lim 22” , lim m (5—z}tang, lim Vx. 

zt=->—0 


x= =0 tan 2 gz=0 


18. Prove the existence of ‘the limit (called the Euler 
constant): 


eee 3° 
(prove that the considered sequence is decreasing and 
bounded, applying the inequality from Exercise 14). 

19. Prove that if the differentiable functions f and g 
satisfy the inequality /'(x)g(x) Æ g'(x)f(v) for every v, 
then between any two roots of the equation f(x) = 0 
there exists a root of the equation g(x) = 0. (Consider 


f(x) 
£ a 


Clim (14 545+. „+ —logn) 


the auxiliary function 


§ 8. DERIVATIVES OF HIGHER ORDERS 


8.1. Definition and examples 


The derivative of the derivative of a function f is 
called the second derivative of this function. Similarly, 
the third derivative is the derivative of the second de- 
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rivative. Generally, the n-th derivative is the derivative 
of the (n—1)-th derivative. We denote the derivatives of 
higher orders by expressions of the kind: 


+ +t i a’ 
PAD Gous A ee, SOP. eg id siti oe 


So we have 


Ti 28 EA 
dx” dæ \daæ"™'] 
E.g. let f{(#) = æ. We have f(s) = 32%, f(z) = 6a, 
f(a) = 6 and f(z) = 0 for n > 3. More generally, 


(1) ala = n(n—1)-....(n—k+1)a"-* for k<n, 
a(x") a! 
asx” 


If a is a real number (but not a positive integer), 
then we have 


ak a a-k 
(2) gallto = a(a—])-....(a-k+1)(1+2) 


for an arbitrary positive integer k and for an arbitrary 
z>—l1. 

The function e has the property that its derivatives 
of all orders are identical with itself. 

Taking f(x) = sing we have 


(3) f(x) =cosz, f(x) =—sine, 
f'a) =—cosz, fla) =sine. 


Here the equation /™(x) = f®+9(x) holds. The same 
equation is satisfied by the function f(x) = cosg. 

Let us note by the way that it is convenient to con- 
sider the derivative of order 0 as equal to the function 
f(x) = f(x). The above given equation holds also for 
n= 0. 

The formula (1) makes it possible to calculate easily 
the k-th derivative of a polynomial of degree n: f(a) =: 
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= a+ a+... +a”. Substituting «=0 in f(x) (for 
k=0,1,...,”) we find: 


(4) ag=f(0), a =f'(0), a, 


I 
X 

TR 
A 
= 
~" 
N 
3 

| 


Hence we obtain the formula 
(5) f(t) = f0) + af (0)+5 10) fob S70) 


which we shall generalize below. 

As an example of the calculation of derivatives of 
higher orders let us mention the formula for the second 
derivative of the inverse function. 


As we know, ae = pa Hence 


dy dn” 
alt ay 
ar ‘dwj do da? dg 
d? de dy (4 dy ’ 
dx 


In applications in physics the second derivative ig 
often of importance. In particular, the acceleration of 
a particle as a derivative of the velocity with respect to 
the time is the second derivative of the distance covered 
T Hence the force acting on 
the particle is equal to m AS 


with respect to the time, i.e. 


where m denotes the 


mass of the particle. 


8.2*. Differentials of higher order 


We define the second differential of a function f 
as the differential of the differential of the function f. 
Speaking more strictly, we define it as the differential 
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with respect to the increment h of the differential of 
the function f with respect to the increment h; the variable 
with respect to which the differentiation is performed is z. 
Then, writing y = f(x) and denoting the second dif- 
ferential by d'y we have 


1 d + +t tt 9 
y = d(dy) = d(y'h) =g h)h = y” k = y”(dx¥. 


Hence we see that the second derivative of a function f 
is the quotient of its second differential over the square 
of the differential dæ (which explains the notation of 
the second derivative). 

Generally, the n-th differential d'y is defined as the 
n-th iteration of the differential, i.e. d'y = d(d"~'y) (with 
respect to the same increment h). 

Then we have 


(6) d'y = y(da)". 


We prove this by induction. Formula (6) holds for 
n = 1 (and as we have seen for n = 2, too). Assuming this 
formula for n, it has to be proved for n+1. Now, 


1 n n n d n N 
Oty = d(d'y) = aty™(dx)"| = = [y™(da)” dx 


= y”+ (de) 

EXAMPLE. The derivatives of higher orders of the 
inverse function (cf. the previous section) may be cal- 
culated by means of differentials of higher orders as 
follows. Let the function x = g(y) be inverse to y = f(x). 
The differentials dy, @y, @y etc. will be understood as 
dyy, dyy, dy etc. Evidently, dy = 0, dy = 0, 

Since y’x’ = 1, we have dy = y’a’dy. Differentiating 
with respect to y, we obtain 


dy’ d 
= (GE e+ Fy) (ayy = "wk + yeaa. 


0= æ 
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Similarly, 
0 = KEEA By = o"a [y (a P +3y x'e” 4+ yŒ” (dyp. 


In this way we obtain equations which make it 


possible for us to calculate the derivatives x’, 2’, æ”, ..., 
successively: 
yx =t, 
y” (æ ne +y'g” = poea 0, 


ie 8+ 3y”x , g” py'a” = ne 0, 


8.3. Arithmetical operations 


Let y = f(x), z = g(x). We verify easily by induction 
that 


(1) (Hz = y™ Ha 
and 
(8) (yay =y. 


For the n-th derivative of a product, the following 
Leibniz formula holds: 


(9) (yz) = yet (i ee Ng! +( yaa" +. + ye) 


n 
=> (7) yor® , 
kx0 


We shall prove this formula by induction. For » = 1, 
we know this formula as the formula for the derivative 
of a product. Let us assume this formula to hold for n 
and let us differentiate it. We obtain 


n 
(yz)ntD — 2 {(z) ytkD) glk) 1. (:) yin) zaro) 


k=0 


= yt Dy ps {yaro 2k) f) 4 (, J JI 4 yan 
n+1 


n+l a 
= > ( k } yon K) g0) 
k=O 
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(i) + (2s) = (k) 
(ef. § 1, (4)). 


EXAMPLE. To find the n-th derivative of the function 
xe”, let us write y = œ and z= v. As is easily seen, only 
the two first terms do not vanish in the formula (9). Hence 

a 


da” 


since 


(xe) = E(x +n). 


8.4. Taylor formula (:) 
The Lagrange formula (§ 7, (11)) is the “‘first ap- 
proximation” of the following Taylor formula: 


Let us assume the function j to be n times differentiable 
in an interval axa<b. Let us write h=b—a. Then 
f(b) may be represented in the following form: 


(b— a)? 
2! 


(10) f(b) = f(a) +Ë 


f(a) +... 


_ (b= a) mg) 4 | 

“a (n—1)! Í (a)+ fF, , 

where 

ag — o'ym 
(n—1)! 

where O and ©’ are suitably chosen numbers satisfying 

the inequalities 0< O<1 and 0< O <1. 


Proof. According to SS (10), we have 


(11) R= a (a+ Oh) = f(a + O'h), 


(12) Ry =f(b)—f(a )— LE pray 
(b-a 


“(n—1)! fo Naj, 


() Brook Taylor and Colin Maclaurin (cited in the following), 
respectively English and Scottish mathematicians of the first half 
of the 18th century. 
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Let us denote by ga(x) an auxiliary function obtained 
from R, by replacing a by 2, i.e. 


(13) ga(v) = f(b)— f(a)" of (x)— 


= a i (b— 2) an- 
f (s)—.. Er (a). 


Differentiating we obtain 


— g 


gala) = Fa) + |F) a) + 


+2 SF r@-S re] ++ 


b n= b— n 
+ [nn Sat ram- - Fa o]. 
Thus, gl£) = ear ar f(z). At the same time 


9n(b) = 0, Jala) = 
Applying the sae theorem, we obtain 


9n{b) — Inla) 


alt! = gat O'h), 
i.e. 
— Ry b Oh) ain 
fs -Ca iy (a+ O'h) 
h” 1 1—0 n—-1 n ; 
=- eas (a+ O'h), 

whence 

h” 1—0 n-1 j i 

R= (a+O'h), 


aceording to the second part of formula (11); this is 
the so called Cauchy-form of the remainder. 

To prove the first part of formula (11), i.e. the 
Lagrange formula for the remainder, we shall apply to 
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the functions g,(x) and u,(”) = (b— x)” the Cauchy theo- 
rem (§ 7.5, 5). We obtain 


Gn(0)—Gr(@) Jala + Oh) 
Un(b) — unla) unla + Oh) ` 


Taking into account the equations u,(b) = 0, u,(a) = h" 


and u;(z) = —n(b—a)"—* we conclude that 
— Ra b — Oh x 1 
—— = (b—a— 0h" bd ) f Xa+ Oh) =o a 
—h (n—1)! n{b—a— Oh) 


whence the remainder R, is obtained in the Lagrange-form. 
Thus, the Taylor theorem is proved completely. 
Substituting b = x and a = 0, we obtain the Mac- 
laurin formula: 


(14) f(x) = f(0)+ 


where 


n? 


= 


2"(1—o6’)y" 
(n--1)! 


The above formula is satisfied assuming the function f 
to be n times differentiable in the closed interval Or 
or 20, according as to whether x > 0 or x < 0. (As is easily 
seen from the proof, the assumption of the n times diffe- 
rentiability of the function may be replaced by a weaker 
assumption, namely, it is sufficient to assume that the 
(n—1)-th derivative is continuous in the whole interval 
and that the n-th derivative exists inside the interval; 
these are the assumptions which we have made for n = 1 
in Rolle theorem). 

EXAMPLES AND APPLICATIONS. («) Let us apply the 
Maclaurin formula substituting f(x) =e and n =2 in 
formula (14). Since 


f(e)=e=f'"(ev) and f(0)=1 =f(0), 
we have 


(15) R, = i Ox) = f(0'x) 


x 
e7 =] ++ g 
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Hence we conclude that for any œ the inequality 
(16) e>1+e2 
holds, because 27? >0 and e% > 0. 

Inequality (16) possesses a clear geometrical content 
on the graphs of the functions y = e* and y = 1+-42. 

(8) The Taylor formula makes it possible to sharpen 
the de l'Hospital formula (§ 7, (31)) as follows: if the 
functions f and g possess continuous n-th derivatives and if 

f(a) =0, f(a) =0, ..., (a) =0, 

g(a) = 90, g(a) =0, .., g(a) =0, but ya) 40, 
then 
„n $æ) _ f(a) 

i ae g(a) 7 GMa)” 

Indeed, according to our assumptions and the Taylor 

formula (10) (with b replaced by s), we obtain 


f (2) = 


(ea) ma + O(a—a)] 
and 


e- ay 


g(x) = — g" [a + O'(e@—a)]. 


Thus, 
ilz) _ {Pla +0(z—a)] 
g(s) g[a+ O(a—a)] 
Passing to the limit for s tending to a and basing 
on the continuity of the functions {/™ and g™, we obtain 


formula (17). 
sing 


For example to calculate im es, we write f(x) = 
z=0 SING 
=g— sing and g(x) = xsing. Thus we have 
j0) =0 =g (0), F (4) =1—cosz, 
g'(x) = sine +.xccose, 
f(0)=0=g'(0), f'(*) =sina, 
q''(%) = 2cosx—wxsine , 
j0) =0, rO =2. 
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Applying formula (17) (for n = 2) we obtain 


. £—-sing 0 
(18) pe Te Wee ama 
Similarly we find 
(19) lim (cote 5) =0. 
z=0 v 


1 reosxr— sinr 


For, cotr—— = and writing 
x xrsing 


f(x) =xcosr—sing and = g(x) = sing 
we obtain the required formula applying a calculation 
completely similar to the previous one. 
(y) Applying the Maclaurin formula to the function 
f(z) = a and taking into account that 


tt 1 t 
f'(x) = i pe f(0)=0, f(0)=1 


we get 


g? 
log(l +2) = 2- yT FOr 
for x> -—1. 
In particular, we have, for x = = , 
] n+l 1 1 


0 <——log~—— = 


n n 2n2 ` 


1 2 
on? (1 +5 6.) 


Since the series >) is s convergent (cf. § 3, (14)), the 
n=l 
an 


series > (= log ™ og 
sum of “the last series by y. Thus we have 


y = lim 2 (glog #7 
n= k k 


saa zte + —log 5. 


n=% 


| is convergent, too. We denote the 


3, n+l 
ees 


; A ae 1 
= lim [a 5+ cet 5, loe(n-+ 1) : 


N=O0O 
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n+l 
n 

quently, we obtain (cf. § 7, Exercise 18): 
1 
2 


But lim [log(n+1)—logn] = lim log = 0; conse- 
nco n=% 


(20) y = lim (2 a 


n=% 


1 
+... + lee) ; 
Approximately, the Euler constant y = 0,5772... (?). 


8.5. Expansions in power series 


We conclude immediately from the formula (12) that 
if lim R, = 0, then 


(21) jo) = X C= jma). 


In particular, if we have lim #, = 0 in the Maclaurin 


n=0 
formula, then the function f(z) may be expanded in 
a power series: 


© 


(22) jæ) = #0) + 3 OAO = DZ ț o) 
1! 2! n! ` 
n=0 

Before proceeding to applications of the above theo- 
rem we note that if all derivatives {™ are uniformly 
bounded in the interval 0z, i.e. if a number M exists 
such that the inequality M > |f™(@x)| holds for each n 
and for any © satisfying the condition 0 < © < 1, then 
f(x) has the expansion (22) in a (Maclaurin) power series. 


R æ” 
-M, and since lim ~; = 0, 


gr 
Ja 
ni n=00 . 


For, | Rp] = |— 02) 


we have also lim &, = 0. 


n=00 


(@) Till now it is not known whether y is a rational number 
or an irrational number. 

Leonhard Euler (1707-1783), a great Swiss mathematician; 
mathematics owes him, besides many new results, a systematic 
elaboration of the mathematical analysis of those times. 
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Remarks. («) The convergence of the series appear- 
ing on the right side of formula (22) is not a sufficient 
condition of equation (22), i.e. of the expansibility of 


the function f(x) in a power series. 
1 


For example the function f(z)=e = (for x # 0), 
{(0) = 0, cannot be expanded in a power series although its 
Maclaurin series is convergent; we have here f™(0) = 0 for 
each n. 

(B) Formula (4) may be generalized to a general 
power series. For, if /(#) =a,+a,7+a4,2°+..., then 


1 
a, = f(0), a, = z7 f'(0), and generally, 


(23) Om = = (0) « 


In other words, if a function possesses an expansion 
in a power series, then it possesses only one such expan- 
sion, namely, the Maclaurin expansion (formula (22)). 

To prove this statement, we shall first prove by in- 
duction that the assumption 


co 


f(a) = 2 anI” 
n=0 
implies 
FAx) = DA n(n—1)-....(n—Kk+1)a,x"-*. 
n=k 


Substituting in this formula x = 0, we obtain equation (23). 

APPLICATIONS. 1. œ =1+ Dione: = J oe 

1! 2! n=O n! 

To prove this formula, we note that writing f(x) = e 
we have j™@(x)= e and f™{0)= 1. Moreover, the de- 
rivatives of all orders are uniformly bounded; for, if 
0 <x, then {™(Ox) < & and if 0 >x, then (Ox) < 1. 


In particular: 1’, e= 1+ Irat 
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' ao Ë æ 
2. sing =I Bit gi 
Applying formula (3) of § 8.1 we conclude immedia- 
tely that the derivatives of all orders of the function 
sin are uniformly bounded (by the number 1) in the set 
of ‘all real numbers. Moreover, f™{0) = sin0 = 0 for 
nm=0,2,4,... and f(0)= 1, f’(0) = —1, f¥(0) =1.,... 
Similarly, we prove that 
2o at 
3. coss = 1— ata 
We shall deduce now the Newton binomial formula 
for arbitrary real exponents (which are not positive 
integers) and for |x| <1: 


4. (1+2) = 1tee+ Me +. 
S a(a—1). ANED pa, 
n=0 . 


We shall consider the cases of x positive and of «x 
negative, separately. 
1° x> 0. Since 
f(a) = ala —1)- ...- (a—n 1) (1 +æ)” 
(cf. (2)), the remainder in the Lagrange-form is of the 
following form: 
_ a(a—1)-...-(a—n+]) 


R,(x) = l el + 0,2)" " (*) . 
Since. tE TSA wy nD i 
aes n! 
for |x| < 1, to prove that lim R,(x) = 0 it suffices to show 


that for a given x the sequence (1+ 0,2)" ",n=0,1,2,..., 
is bounded. Now, according to the inequality 7 > 0 we 
have 1<1+0,"%<1+¢2. Thus, 1 < (1+ On)" < (1+0 


C) We add the index n to © in order to point out that © 
depends on n. 
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or (1+2)* <(1+ Onz) <1 according as whether a >0 
or a <0. Moreover, (1+ Ona)” <1. 


Hence the considered sequence is bounded 


2° «<0. Writing the remainder in the Cauchy-form, 


we have 
ott a —n + n t n~ t nan 
kas Coe, x"(1— OF) 1+ 04, 2) : 
(n—1)! 
Just as before, we have 
jim (a-—1)(a—2)-...-(a—n +1) 


Pio. . 
n=% (n ae T) AS 
it is to be proved that the sequence (1— 04)" T1 -+ Ohr)" 


is bounded, i.e. that the sequences (Fer) ‘ and 
(1+ 0x) are bounded. For this purpose we write 
y =—x. Then y>0O and O,> Ony, whence 1— O; 
<1—On,y <1. Thus (=e) <1 
f ” \1— Ony i 
On the other hand, 1—y < 1— Oy < 1 and so 
(1— y) < (1— Ory <1 


or  1<(1— 0y} < (1y) 
according as whether a—1 > 0 or a—1 <0. Thus, both 
sequences are bounded. Hence lim R,T) = 0 


n= 


EXAMPLES. ere a =$ we obtain 


1 x 1-3 

yVlt+e=1+5%-54 OS ae T 47T 
For a =—4, we have 

1 _;_1 Pa _1:3 5 4 

yl+e 2 2.4 2-4-6 

Hence 
Sa ea es 
1—2# 2 4 2-4-6 
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The above formula makes it possible to apply to the 
expansion of the function aresing in a power series the 
same method which we have applied expanding the 
functions logs and arctanz. Namely, as is easily seen, 
the series appearing in this formula is the derivative of 
the series 


jl 
S(x) = a+ z 
But 


d . : 
—arcsing = hence arcsing = S(z#)+C. 


1 
dx yiz’ 
At the same time arcsin0 = 0 = §(0) and so C=0, 
i.e. arcsing = S(x). In this way we have the following 
formula: 


1a 1-3 1-3-5 
5. arcsing = @+ 5: gto 3 atone T. irg ey |E|<1. 


We note that substituting x = 4 and taking into ac- 
count the fact that sin ¿x = 4 we obtain: 


ad 1 1 HS 1 Lee 1 


2467 90°" 


ae 
$ 
bo 
we 
bo 
wo 
ts 
re 
a 
a 
on 


8.6. A criterion for extrema 


We have proved in § 7.4, 2 that if a (differentiable) 
function possesses an extremum at a point x, then f(s) = 0. 
However, the converse theorem is not true: the equation 
}'(x) = 0 does not imply the existence of an extremum 
at the point x; the example of the function f(z) = 
shows this. The investigation of the derivatives of higher 
orders leads to the following more precise criterion for 
the existence of an extremum. 

Let us assume that f'(c) = 0, f’’(e) = 0, ..., fee) = 0 
and f™ (ce) #4 0. Then, if n is an even number, the function f 
has a proper extremum at the point c, namely a maximum, 
if f{M(e)< 0, and a minimum, if f{M(c)> 0. But if n is 
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an odd number, then the function does not possess an ex- 
tremum at the point c. (We assume the continuity of the 
n-th derivative at the point e). 

Indeed, applying the Taylor formula we have 


h he 
(24) Heh) = Ho) + BP Ot a OMe) + 
+Ë e+ On), 


whence according to the assumptions of our theorem 
we obtain 


h” 
(25) fle +h)— f(e) = fe + Oh). 


Let us assume n to be an even number and let {™(¢) < 0. 
Because of the continuity of the function {™ at the 
point ¢ we know there exists a ô> 0 such that the in- 
equality |a—c|< 6 implies /(™(x) < 0. Since |Oh| < 6 for 
|A| < 6, so f™(e+ Oh) <0. Hence we conclude by (25) 
that if 0 < || < ô, then f(¢+h)—f(c) < 0 (because h” > 0 
for even n). This means that the function f possesses 
a maximum at the point c. 

It is proved by analogous arguments, that if n is an 
even number and if f™(e)>0, then f(e+h)—f(c) > 0 
and thus the function has a minimum at the point c. 

Now, let us. assume that n is an odd number. Let 
{™(e) < 0 (in the case /™(c) > 0 the arguments are analo- 
gous). As before we choose a number 6 > 0 in such a way 
that f™(e+ Oh) < 0 for |h| < 6. Then for 0<h<6 we 
have the inequality f(¢+h)—/f(e) < 0, i.e. f(e) > f(e+h) 
and for —ô < h< 0, we have the inequality f(e+h)— 
—f(c) > 0, showing that f(c) < f(e+h). Thus, there is 
neither a maximum nor a minimum at the point c. 

EXAMPLE. The function f(x) = x” possesses a minimum 


at the point 0, if n is an even number. If n is odd, then 
there is no extremum at this point. 
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Indeed, the first derivative of the function x" not 
vanishing at the point x = 0 is the n-th derivative (cf. (1)) 
and f(x) =n! 

Remark. The previous theorem does not determine 
for all functions (arbitrarily many times differentiable) 


whether an extremum exists at a given point (e.g. for 
1 


the function e ** considered in § 8.4 all derivatives of 
which vanish at the point 0). However, it always permits 
us to answer this question for functions having a Taylor 
expansion (formula (21)) in a neighbourhood of a given 
point a. For, it follows from formula (21) that if the 
function f is not constant, then not all derivatives of 
this function vanish at the point a. 


8.7. Geometrical interpretation of the second derivative. 
Points of inflexion 


As we have seen in § 7.7, 3, if f’(c)> 0, then the 
function increases in a neighbourhood of the point o. 
Hence if f(e) > 0, then the function f’ increases; thus, 
assuming f‘(c) > 0, the function f increases faster and 
faster. 


1. If f(e) > 0, then in a certain neighbourhood of the 
point c the curve y = f(x) lies above the tangent of this 
curve at the point [c,f(c)] (thus, it ts directed with the 
convexity downwards ). 

Analogously, if f’’(¢)< 0, then this curve lies locally 
below the tangent (thus, it is directed with the convexity 
upwards ). 

In both cases we assume the continuity of the second 
derivative. 

Indeed, let us estimate the difference between the 
differences quotient and the derivative 


p(n) = EEDA hee), 
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According to the Taylor formula, we have 
' k, 
j(e-+h)—f(c)—hf'(c) = 57'"(e+ Oh). 


Hence, assuming /’’(c) > 0, for sufficiently small h we 
also have f’(c+ Oh) > 0, from which it follows that 
f(e+h)—f(c)—hAf'(e) > 0. Interpreting the differences quo- 
tient as the tangent of the angle between the secant 
and the X-axis we conclude that for h > 0 this tangent 


c cth 


Fic. 22 


is greater than /'(c), i.e. greater than the tangent of 
the angle between the tangent and the X-axis. This 
means that the arc of the curve lies above the tangent. 

The proof of the second part of the theorem is com- 
pletely analogous. 

EXAMPLE. The parabola y = 2? lies, in the neighbour- 
hood of any point, above the tangent at this point. The 
second derivative is equal to 2. 

A curve y = f(x) is said to possess a point of inflexion 
at the point c, if for sufficiently small increments 
h (|h| < 6) the arc of the curve lies for positive increments 
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on the other side of the tangent to the curve at the point 
[c, f(¢e)] from what it does for negative increments. In 
other words: if a number 6> 0 exists such that the 
expression 
yh) = f(e+h)—flc)—hf'(e) 

is positive for 0<h< 6 and negative for 0>h>-—é6 
or conversely: negative for 0<h< 6 and positive for 
0>h>—d. 

EXAMPLE. The sinusoidal curve y = sing has a point 
of inflexion at the point 0. Indeed, sinh~—sin0—hcos0 
= sinh—h. This difference is negative for h>0 and is 
positive for h < 0. 

Similarly, the cubic parabola y = a possesses a point 
of inflexion at the point 0. 

It follows from theorem 1 that if f(e) 4 0, then the 
curve lies (locally) on one side of the tangent. Hence 
the point ¢ is not a point of inflexion. In other words: 

2. If a point c is a point of inflexion of a curve y = f(x), 
then f’’(c) = 0. 

This theorem cannot be reversed: the second deriva- 
tive may vanish at a point ¢ although the point ¢ is not 
a point of inflexion (just as the first derivative may 
vanish although there is no extremum at the given point); 
e.g. the curve y = a has a minimum at the point 0 
and so this point is not a point of inflexion of this func- 
tion although the second derivative 12x? vanishes for x = 0. 

To get a more precise theorem, further derivatives 
have to be considered. This leads to the following theorem : 

3. If f’(e)=0, f (e) =9,7 ..., JOD (0) = 0 but fe) 40 
then in the case of an odd n the curve y = f(x) possesses 
a point of inflexion at the point c; in the case of an even 
n, c is not a point of inflexion. (We assume the continuity 
of the n-th derivative at the point c). 

Indeed, applying the Taylor formula (24) we obtain, 


y(h) = f(e+h)—fle)—hf'(c) = Že Oh). 
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Let us assume n to be an odd number and let f(c) > 0 
(the arguments in the case f™(c)< 0 are analogous). 
Then for sufficiently small increments h we have 
{™(e+ Oh) > 0. Hence we have y(h)> 0 for h> 0 and 
p(h) <0 for h< 0. Thus, the point c is a point of in- 
flexion of the curve y = f(z) 

On the other hand, if n is an even number, then h” > 0 
independently of the sign of h, whence y(h) has the same 
sign as /™(c). Hence the curve lies on one side of the 
tangent to the curve at the point [e, f(c)]. Thus, the 
point ¢ is not a point of inflexion. 


Remark. As in the case of the extrema, the question 
whether c is a point of inflexion may always be answered 
(according to Theorem 3) for functions expansible in 
Taylor series in a neighbourhood of the point c. At the 
same time the points of inflexion of the curve y = f(x) 
are extrema of the curve y = f'(x). 


Exercises on § 8 


1. Prove the ae, formula: 


a” ngoni, 
aan (x @) = = (—1) s 
, ae F logg 
2. Find the n-th derivative of the functions: S3 
€* CORT. 
3. Evaluate: 
— eT? — — si 
ime o lim = ieee lim Z cotta}. 
z=0 &—BRnNg pups æ z=0 (2? 


4. Expand the functions sinhz and cosh in power 
series. 


1 
5. Sketch the graphs of the functions 2%, e*, logsinz, 
showing their extrema, points of inflexion, asymptotes, 
points of one-side discontinuity or points of both-sides 
discontinuity (if any exist). 
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6. Prove that if an n times differentiable function 
vanishes at n-+1 different points of a given interval, 
then there exists in this interval a point at which the 
n-th derivative vanishes. 


1 
i. Wet f(a) = Loa for x + 0 and f(0) = 0. Prove that 


f'(0) = 0. Deduce as a corollary that the function g de- 
fined by the conditions 


1 


giv) =e * for «#0 and = g(0)=0 


possesses at the point 0 derivatives of all orders equal 
to 0 (cf. § 8.5, Remark («)). 


n 
8. Prove that e” < (2m +1)— . Deduce that 


. lnm _ 1 


CHAPTER IV 


INTEGRAL CALCULUS 


§ 9. INDEFINITE INTEGRALS 


9.1. Definition 


A function F is called a primitive function of a func- 
tion f defined in an open interval (finite or infinite), 
if F’(x) = f(x) for every z. 

For example the function sinz is a primitive function 
of the function coss. Any function of the form sing + C, 
where C is a constant, is also a primitive function of the 
function coss. 

If a function f is defined in a closed interval a < z < b, 
then the function F is called its primitive function, if 
F(a) = f(x) for a < æ< b, F4(a) = f(a) and F-(b) = f(b). 

1. If two functions F and G are primitive functions 
of a function f in an interval ab (open or closed), then 
these two functions differ by a constant. 


Indeed, if F’(x) = G(x), then, according to Theorem 4 
of § 7.5, there exists a constant C such that G(r) = F(@)+C 
for every 2. 

Conversely, a function obtained by adding a constant 
to a primitive function of a function f is also a primitive 
function of the function f. Thus the expression F'(2%)+C 
is the general form of a primitive function of the func- 
tion f. We indicate this expression by the symbol f f(a) dx 
(“the integral f(x)dx”) and we call it the indefinite integral 
of the function f. So we have 


1) f f(w)de =F(x2)+C, where F'(x)= f(x), 
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(2) Z | Haydn = f(a), 
(3) ie dx = F(a) +C. 


The evaluation of the indefinite integral of a function f, 
i.e. the calculation of the primitive function of a func- 
tion f is called the integration of the function f. So in- 
tegration is an inverse operation to differentiation. 

It follows from the definition of the indefinite integral, 
that any formula for the derivative of a function automa- 
tically gives a formula for the integral of another function 
(namely, the derived function). For example from the 

dsing 
dæ 
In general, however, the problem of the calculation of 


the integral of a continuous function, which we do not 
know to be a derivative of a certain function, is more 
difficult than the problem of differentiation. As we have 
seen in § 7, the differentiation of functions which are 
compositions of elementary functions does not lead out 
of their domain; yet an analogous theorem for indefinite 
integrals would not be true. It is known only that every 
continuous function possesses an indefinite integral 
(cf. § 9.2). However, this theorem gives us no practical 
procedure of evaluating the indefinite integral of a given 
continuous function. 

EXAMPLES. Applying well-known formulae from the 
differential calculus we obtain immediately the following 
formulae: 


formula 


= cosg, we obtain f cosxda = sing + C. 


(4) fodr=0, 
(5) fadx =ax+C, 
(6) [rae = Foote, 


(7) f cosade =sinrz+C, 
(8) f sinvdx = —cosæ + C, 
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dz 
cos? x 


dx 
ao) f S=togiai+c, 
(11) fede =e+C 


dx 4 
12 f = arcsing+ C , 
(12) ae 


(13) | ae = arctanz+C, 


(9) 


=tanr+C, 


a | sado = att C, if a“#—land e>0. 
Remark. If the domain of x for which the equation 
F(a) = f(x) is satisfied is not an interval (finite or in- 
finite), then it cannot be stated that the expression 
F(x)+ C gives all primitive functions of the function f 
in this domain of arguments. 
For exampie, log|z|-+ C gives all primitive functions of 


the function = in each of the two domains œ < 0 and 7 > 0, 


separately, but not in the whole domain of æ real and 
different from 0. Namely, the function G(x) defined as 
log|x| for x < 0 and as log|z|+1 for x 4 0 is a primitive 


function of the function for all z 40 although it is 
not given by the formula log|æ| + C. 
Let us complete now Theorem 1 as follows: 


2. Let a point x, be given inside an interval ab and 
let an arbitrary real number y, be given. If a function f 
possesses a primitive function in the interval ab, then it 
possesses one and only one primitive function F such that 
F (20) = Yo. 

Let P(x) be an arbitrary primitive function of the 
function f(x) in an interval ab. Let us write F(x) = P(a)— 
— P(x) +Y. Then we have F(x) = P'(x)= f(<) and 
F(x) = Yo. Hence the function F satisfies the conditions 
of the theorem. 
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Moreover, it is the only function satisfying these con- 
ditions, since any other primitive function of the func- 
tion f is of form F(x)+C, where C Æ 0, and this implies 
F(%)+C = Yot O FY. 

Geometrically, this theorem means that given any point 
on the plane with the abscissa belonging to the interval ab, 
there exists an integral curve (i.e. the graph of a primitive 
function) passing through this point. The integral curves 
being parallel one to another, only one integral curve of 
a given function f may pass through a given point on 
the plane. 


9.2. The integral of the limit. Integrability of continuous 
functions 


We have proved in § 7.9 that given a sequence of 
functions F, (z), a <æ <b, such that the derivatives are 
continuous and uniformly convergent in the interval ab 
to a function g(x) and that the sequence F,,(¢) is con- 
vergent for a certain point ¢ belonging to the interval ab, 
the sequence F(z) is convergent for every zx belonging 
to this interval; moreover, writing F(z) = lim F, (x), we 
have F’(x) = g(x). 

Hence, the following lemma follows: 

1. If the functions f(x) are continuous and uniformly 
convergent in an interval ab to a function f(x) and if they 
possess primitive functions, then the function f(x) pos- 
sesses also a primitive function. 

The primitive functions F(x) may be chosen in such 
a way (according to § 9.1, 2) that the equation F,(c) = 0 
holds for a certain point ¢ of the interval ab, for each 
value of ». Then 


J t(a)da = lim Faa) +6, 


i.e. the integral of the limit equals to the limit of the 
integrals. 
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Indeed, to obtain our lemma it is sufficient to sub- 
stitute in the above formulation f, in place of F, and f 
in place of g. 

2. THEOREM. Every function continuous in an interval 
ab possesses a primitive function in this interval. 

By the theorem proved in § 6.4, every function con- 
tinuous in the interval ab is a limit of a uniformly con- 
vergent sequence of polygonal functions. Hence, according 
to the lemma it remains only to prove that any polygonal 
function f possesses a primitive function. 

According to the definition of a polygonal function 
there exists a system of n+1 points a) < a, < ... < ap, 
where a= a, a, =b, and two systems of numbers 
Cis Czy -3 Cn ANA di, dg,..., dn such that 


f(x) = cæ de for a y<uc<a, (hk =1,2,...,0). 

Let us write 

Fiy(w) = ġe + drat er for dk- SE Qa, 
where e, = 0 and 
k41 = 40k ak + drar + er— (46x41 0% + dear Oe) 
for k >1. 

Then F(a.) = Fx41(a,), whence the collection of the 
functions F, Fz, ..., Fn defines one function equal to each 
of the functions of this collection in the suitable interval, 
respectively. 

Differentiating the function Fẹ we obtain immediately 
F(x) = f(x), i.e. the function F is primitive with respect 
to the function f. 


9.3. General formulae for integration 


Let us assume the functions f and g to be continuous. 
Then the following formulae hold: 


1. f f@)+g(a)lde = f f(a)de+ f g(a)de, 
since al Haydo+ | g(x) ax) = f(x) + g(x). 
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2. f af(a)de =a f f(a) de, 

F a _ d f S 

since (e f ioar) = Os j(x)dx = af (x). 
EXAMPLE. The integral of a polynomial: 


f (dep aye + ont anada = C+ aye + Fa? + Fatt 


3. The formula for the integration by parts: 


f Ha)g'w)de = f(a)g(a)— f f(a) g(a) de 


(if the functions f’ and g’ are continuous). 
We write this formula more briefly, taking y = f(x) 
and z = g(x) as follows: 


{yt a =ye— | 2% do. 

To prove this formula, let us differentiate its right 
side. We obtain: yz’ + y’z—zy’ = yz’. This is the integrated 
function of the left side of the formula. Thus the formula 
is proved. 

A special case of formula 3 is the following formula 
obtained from the formula 3 by substitution z = a: 


as dy 
3. [yao = yo fofas. 
EXAMPLE. f logrdxe = slogs— f stds = slogs—s+ C. 


4. The formula for integration by substitution (i.e. the 
formula for the change of the variable): 


fon LO ao = f gww, 


where on the right side it has to be substituted y = f(z) 
after evaluation of the integral. 
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We rewrite this formula more briefly, writing y = f(z) 
and z = g(y), as follows: 


fei WY an = f zdy. 


Let us write G(y) = f g(y)dy. To prove the formula 4 
it has to be shown that the derivative of the function 
G[f(x)] is equal to the integrated funetion on the left 
side of this formula. Now, 


aGTf(x)) _ (S| - daj(x) 
dx dy ly-t de 


As is seen, from the point of view of the calculation 
we may reduce by the differential. The formula 3 may 
be written also in the following form: 


fya = yž— | zdy. 


aie) 


= gff(2)] 5. Q.E.D. 


EXAMPLES. (a) J g (aw) de == J g(y)ay, where y = ax 


Namely, substituting f(x)= az in the formula 4, 
we have 


1 1 
z f g(ax)ads = = f g(y)dy. 
(B) Similarly we prove that 
f f(w+a)de = f tudy, where y=2+4. 


(y) (1) To evaluate the integral pa. it fe. we substitute 


y = 2. We obtain: 
pee 1 1 Ma) ay 
I+ J 1+a2° dr 
z1 pe +y) = slog(1 +2). 


£) To simplify the calculation, we omit the constant C in the 
example (y) and in the further examples. 
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Since—as we said—by the integration the differential 
df(x) may be substituted in place of f(x)dx, i.e. in the 
given case, d(x?) in place of 2xdz, the above calculation 
may be performed in a little shorter way: 

° ædx 1 dæ 1 A 
J ipa) Pipa get). 


(5) We have for n>1 


vax ae 1 1 
(+a) ~ 9 io ~ 2(n—1) (1 +a)" ae 
(£) [tana de = fE = — eae = —log|cosz]. 
COSL cosg 


The formulae (y) and (£) are easily obtained from the 
following general formula: 


O [eae = fZ =rglyi+c. 


Substituting y = 1+2? in formula (5) we deduce this 
formula easily from the following general formula: 


dy =f _ 1 
Jv? oe i loa 


As is seen, the method of integration in the above 
examples consists in finding a function y = f(x) such 
that the given integral will be transformed in an integral 
with respect to y (which is easier to calculate). This 
makes it possible to replace the calculation of the integral 
on the left side of the formula 4 by the calculation of 
the integral on the right side of this formula. Sometimes, 
the reverse procedure, i.e. the replacing of the right 
side by the left side is more suitable; to calculate the 


integral f g(y)dy we look for a strictly monotone func- 
tion y = f(x) such that the integral f gta O (2) a, 


yettt GC (ax~—1). 


may be easily calculated. Denoting by 2 = h(y) the func- 
tion inverse to y = f(x) and by F(x) and G(y) the integrals 
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on the left side and on the right side of the formula 4, 
respectively, we have then 

F(x) = G[f(<)], ie. G(y)=F[h(y)]. 
In other words, 


df (x 
f omas = fatto ae, 
where in the integral on the right side has to be sub- 
stituted x = h(y). 


EXAMPLE. Let us substitute in the following integral 


: T ud 
x = sint, -3Si<z 


f| VEs = | cot E dt = f cos*tdt , 


but cos?t = 4(1+cos2t), whence f costtdt = $t + }sin2¢. 
Since sin2¢ = 2sintcost = 2sint y1—sin?t, we obtain 
hence: 


f y1i— æder = }t+ }sinty1—sin?t 
= harcsing + 4e y1- æ. 
Remark. We verify the correctness of the integration 
by differentiating the function obtained as the result of 


the integration. After the differentiation we should obtain 
the integrated function. 


5. Recurrence methods for calculation of integrals. The 
recurrence method for calculation of the integral f fale) dx 
consists in calculation of the integral for n = 1 (or for 
n = 0) and in reducing the n-th integral to the n—1-th 
one (or an even earlier one). 

EXAMPLES. (a) Evaluate the integral I, = f e-*a"dz. 
Now, I, = f e-*dax = —e-*. Moreover, integrating by parts, 
we have (for n> 0): 


Tys — f wale) =a meet f e-e ae 


= eT H NnIn-. 
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In particular, I, = —xe-* + Is, I, = —2e7? + 2h, ... Multi- 
ni 


n! 
plying I, by n!, I, by Te , In by mI succes- 
sively, and adding, we obtain 

f eraras = —nle-= (+ PAÉH + a) +¢- 


(B) Let In = la F Now, J, = arctan æ. Moreover, 
x 


we have for n>1 


2 
n= [RS re ae f i 
a)” + 
Since 
T a a = —2(n—1)_—,, 
dx (1+2°) (1+2°) 
we obtain integrating by parts 
> eda —1 1 
| PRTA al- aga 
Q+ "nee (1+2?) 
-Z — a ham]. 
2n—2 |(1 +) 
Consequently, 
1 £ 1 
In = n— Fose a 
t On—2 (14e 2n—2 "7 
1 2n—3 
x n ae 


~ In—2 (14+2°)" | In—2 
This is the required recurrence formula. 


(y) Let y = f(x), z = g(x). We calculate the integral 
J zy™+D dae applying n times the integration by parts: 


f ey» dr = zy — f 2’y™ da, 
f ZyMda = zyn) — f g'yn-dde, 


f any’dae = ey — J an+ yde. 
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Hence 
f ay) de = 
= ay) — 2’y "T? t.. (yey + (-1)"? [yde ; 


This formula may be applied e.g. to the previously cal- 
culated integral f e~7a"dx after taking into account that 
d*(e-*) 


e~t = (—1)* dk 


9.4. Integration of rational functions 


Let a rational function 
P(x) 
g) = 


be given, where P(x) and Q(x) are two polynomials. 
The integral f f(x)dx has to be evaluated. 

We may assume that the degree of the numerator is 
less than the degree of the denominator. For, if this were 
not so, we could divide the numerator by the denominator 
and then we have to integrate the sum of a polynomial 
(eventually reduced to a constant) and of a fraction, 
the numerator and the denominator of which are poly- 
nomials, and the degree of the numerator is less than 
the degree of the denominator. The first of these two 
terms is easy to integrate (as a polynomial); thus our 


task is to integrate the second component, i.e. a quo- 
tient of the form 2A) where the polynomial P(z) is 


Q(x) 
of a degree less than the degree of the polynomial Q(z). 


The following theorem on rational functions is proved 
in books on algebra: 


Let us call an expression of the form 
A Cz-+-D 
where A and p, or C, D, q and r are real numbers, a partial 
fraction. 
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P(x) 
Q(x) 


fractions the denominators of which are the factors of the 
polynomial Q(x). 

To decompose a rational function into partial frac- 
tions, first the polynomial Q(z) has to be factorized 
into prime factors. Then the coefficients appearing in 
numerators of the partial fractions have to be found. 
The factorization of the polynomial Q(x) in factors is 
obtained applying the theorem known from algebra stating 
that if p is a (real or complex) root of the equation 
Q(x) = 0, then x—p is a factor of the polynomial Q(x); 
moreover, if p is a root of the multiplicity n, then (£ — p)* 
is a factor of this polynomial for each k <n. Finally, 
if u+iv is a complex root of the equation Q(x) = 0 with 
real coefficients, then u--tv is a root of this equation, 
too (of the same multiplicity), and so the polynomial Q(z) 
has the product (x— u— iv)(x— u+ iv) = (x— u} +? as 
a factor. 

The coefficients appearing in the numerators of partial 
fractions are usually found by the so called method of 
the undetermined coefficients, which we shall learn by 
examples. 


Then a rational function 


is a sum of partial 


g— l1 
' ati 1 ee 
The denominator of the rational function (a2) —3) 2)" —3) 
possesses the factors (w—2)?, (x—2) and (r—3). Thus, 
our rational function is of the form 


_ i _ canes BL Torn 
(x—2}(x—3) (æ—2}' x—2 ' r—3' 
To calculate the coefficients A, B and C, we reduce the 
fractions on the right side of the above equation to 
a common denominator. We obtain 
x—1 
(x—2)}{x—3) 
_ (B+ C)a+ (A—5B—AC)a—3A +6B+4C 
E (x—2})}(x—3) l 


9. INDEFINITE INTEGRALS 213 


The numerators on the left side and on the right 
side of the above identity are equal one to another for 
any value of x. Hence it follows that 


B+C=0, A-—-5B-—4C=1, -—3A+6B+4C0=-1. 
These equations give the values A, B and C: 
A=-1, B=-2, C=2. 
Consequently, 
ee ee eee ee 
(z—2}({x—3) (w—2)? x—2 ` w—3° 
We note that the coefficients A, B, and C might be 
found in a slightly simpler way as follows. After reducing 


to the common denominator we obtain the following 
identity: 


Alæ—3)+B(æx—2)(x—3)+0(@—2} = 2-1. 


Substituting in this identity æ = 2, we obtain A = —1; 
the substitution x = 3 gives C = 2. Hence, substituting 
æ = 1, we conclude B = —2. 

Another example of the decomposition of a rational 
function in partial fractions is given by: 

x—1 Boe EB pOr Te oe 
(x2+1)%(@+1) (2+1) 5 +1 sl’ 

Reducing to the common denominator we obtain the 

identity 


(Ax+B)(æ+1)~+ (Cr+ D) (a2? +1)(r +1) + E(2 +1} = 2-1, 


whence we easily find: 
A =l1, B=0, C=}, D = —}, E = —4. 


The theorem on the decomposition of a rational func- 
tion into partial fractions reduces the problem of inte- 
gration of rational functions to the integration of partial 
fractions. Now, we shall see that the partial fractions may 
be integrated by the methods which we have learnt already. 
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Indeed, substituting y = x—p we obtain 
ae [a =Alogy for k=1, 


A 1 


=i eget for k>1, respectively. 


The evaluation of the integral 
(Cx + D)dx 
[(s—g} +r] 
is reduced to the evaluation of two integrals: 
dx (x—q)dx 
| zora i JeF 
Substituting y = «—q, the first of these integrals is 
dy 
substitution z = y/r to the integral f TESI which we 


already know (ef. § 9.3, 5 (B)). 


The second integral we find by the formula § 9.3’ (X) 
and (n) substituting y = (w—q)?+7?; namely, 


reduced to the integral f , which is reduced by the 


Eia- pete or 
—_— . eee eee ° — 88 
~ 2(k—1) [(v—q} +r 


according to whether k =1 or k #1. 

Hence, the integration of rational functions can always 
be carried out (of course, if the roots of the equation 
Q(x) =0 are known). 


or 


EXAMPLES. (a) I = Sa Since 


+aotl=atet+t+e=(e+4P +h, 
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aay, we obtain 


V3 


4 
I= f= ae pee i ae -JE 2 a 
Pti J G+ V3) e+ 
2 
= gzaretanz me AG + 3): 
32° +1022?—ax 
a J ei A 
A B C D 
h eoe et got Pale 
Reducing the right side of this equation to the common 
denominator, we easily find: A = 3, B=4,C = 2, D = —1. 
Integrating, we obtain 


go substituting first y = x a z and then z= 


[= — 95 + 4logie— |= —log|a +1| 
_ Ba+d (7 —1)4 
Sjoa Besa, 


Remark. Analysing the method of integration of 
rational functions, we state that the integral of a rational 
function is of the form 

W (x) + Alog U (a) + BaretanV (a Jj 
where W(x), U(x) and F(x) are rational functions and A 
and B are constant coefficients. 


9.5. Integration of irrational functions of the second degree 


We shall consider an integral of the form 


[= f VY ax?+be+edz. 


First of all, let us consider the case when a= 0. 
Then we may assume that b #0, since otherwise the 
function under the sign of the integral would be reduced 
to a constant. Hence, we have to evaluate the integral 


I= Voatede, b#0. 
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We substitute t=be+e, ie. x= Sat , whence 


sae = 7 Then the integral is transformed into the follow- 


dt 
ing integral: 


9 
T= { viva = f Vizat=Ztvi=Z (be +e) )Vba+e. 


Now, let us assume that a 4 0. We consider two cases: 

(1) b?}—4ac > 0. As is known, this assumption implies 
that the equation az?+br+c=0 possesses real roots 
and the trinomial of second degree is of the form az’? + bæ +e 
= a(z—~p)(x«—q), where p and q are the roots of the 
above equation. Thus, we have 


I= | Vattbatede = f 


aq—tp 
a—t? ` 


i= È, i.e. c= 


Let us substitute a—— 
We obtain 


aq— ap. a 
E fs tle 
This integral being an integral of a rational function 


(since a 
dt 
may be calculated by the methods given in § 9.4. 

(2) b— 4ac < 0. In this case it may be assumed that 
a> 0, since otherwise the trinomial constituting the func- 
tion under the sign of the root, which is of the form 
a[(x— a} +6], would be always negative. We apply the 
following Euler substitution: 


Vaet+brat+e=axVat+t, ie. be+e=2atyVat+Ft, 


that is 


is a rational function, as is easily seen), it 


_ P-e 
b—2t Va 
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Since faa?+bae+c as well as = are rational functions 


of the variable ¢, so our integral is reduced to an integral 
of a rational function. 

The above Euler substitution may be applied also in 
the case (1), if only a> 0. 

If ¢ > 0, the second Euler substitution may be applied: 


Vae+befe=at+ye, ie. av+b=at+2tyVe, 
that is 


at Ve—b 
UD E $ 


Similar to the previous case, we see that this substi- 
tution reduces the integral I to an integral of a rational 
function with respect to the variable t. 

Consequently, we conclude that the integral I may 
be evaluated for all values of the constants a, b, and c. 
It follows also from the above considerations easily that 
if R(u, v) is a rational function of the variable u and v, 
then the integral 


| Rifae® + bate, x) de 


is reduced to the integration of a rational function (thus, 

the integration is performable). 
dx 

Ve+e 

apply the first Euler substitution in a slightly moaified 

form. Namely, let us substitute v. æ +c =t— x, whence 
ead! de +e 


for x2 > —c. We shall 


EXAMPLES. (a) Let I = 


+e 
2t 
_ù(_ t +e, fa 

r= | ay 207 at = | + 

= logit +0 =log|a+ Va*+e|+C. 


Hence t— g = 


218 IV. INTEGRAL CALCULUS 


(B) I = | ¥a?+ cde for a > —c. This integral may be 
evaluated by means of the Euler substitution. However, 
it may be calculated more simply by reduction (by inte- 
gration by parts) to the previous integral. Namely, 


dy aæ -+e —— f æde 
I=a2yY2+e— de = g y+ e 
+e fe u eyte EF 


SoyaFo— | TE de = 2B FoI +o f m. 


Hence, 
I = 50V Be + Slog| a+ Ve+el+C. 


Let us note that the formulae for the derivatives of 
the functions inverse to the hyperbolic functions (§ 7, (22) 
and (23)) make it possible to write directly the formulae 
for the integrals considered in the example («) fore = +1. 
Namely, 


=arsinhe+C = log|e + ye F1 +C, 


f dx 
Ves. 
f Eg = rohe = logla+ Vi] +0 for r>1. 


Remark. As we have seen, the integration of ir- 
rational functions of second degree is always performable. 
However, replacing the quadratic az?+bx-+e¢ under the 
sign of the root by a polynomial of the third or higher 
degree, the problem of integrability becomes in general 
(i.e. without special assumptions on the coefficients) 
impossible to solve in the domain of elementary functions. 

‘In particular, the integral 


ax 
(1—2) (1— ka?) 


cannot be expressed by means of elementary functions. 
Thus, it leads outside the domain of elementary functions 
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(similarly as the integral je leads outside the domain 


of rational functions). It is the so-called elliptic integral. 
Similarly, the integrals 


lie 2x" = kesin? g 


cannot be expressed by means of elementary functions 
(and lead also to elliptic integrals). 


9.6. Integration of trigonometric functions 


Let R(u, v) denote a rational function of two variables 
u and v. The method of integration of the function 
R(sinz,cosx) is based on the substitution t = tan $v. 


We conclude from the identity — = 1 + tan? $s, 


se 


that cos? $e = a and, since coss = 2cos?4z—1, 
pee ee 
O 14+8@ 9 14+8° 
At the same time, 
f t 
sin? 4gs = 1— cos? $s = Tie’ 
whence 
sing = 2sin}xcos$a = me 
a 148° 
Finally, the equation x = 2arctant implies 
de 8 
dt 148° 
The above three formulae give 
2 1-f\ 2 
f R(sing, cosx)dx = $ R( a isa) Tae dt , 


and the last integral, being an integral of a rational 
function of variable t, may be calculated by methods 
with which we have already become acquainted. 
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EXAMPLES. («) Let I = Í; ve 


eas Applying the substi- 


tution t = ae we obtain 
l= fs 1+? _ i= | 2dt 
1—-# 148 ; pe 1-# 


-ffoi Š= = tog |}; |- 


1+t 1+tanje 


—_——— CO = 1 S 
But 1s Aa tan(42+ 427). Consequently, 
de 
=~. = log|tan(}2+}n)|. 
Hence 
ax 
nos log|tan 32, 


since sing = cos(r— 4x) and so 


pdx _ [f Aa— jn) _ 
sing J Conta) log|tan 4a]. 


The last integral may also be deduced easily from 
the integrals (cf. § 9.3, (e)): 

f tan. rdxz = —log|cosz|, if cotardx = log|sinz] , 
since 


dx f pri f sin?4a” + cos? $a 
sing J 2sinġzcosġs 2 sin 4æcos4e 


i 


i tan }cd(}a) + J cot }xd(}2) 
= —log|cos}az!+log|sin}a| = log|tan łe]. 
If we know the integral f a , we find immediately 
the integral fe , Substituting cos” = sin (æ + 4x). 


(8) The irrational functions of second degree may be 
reduced easily to trigonometric integrals of the form 
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R(sinz, cosx). Namely, the functions 


yl—#, yet+l, Yya—l 


may be reduced to the functions of this type by sub- 
stitutions v = sint, 7 = tant, x= sect; in any of these 
three cases the derivative = is also a rational function 
of the functions sint and cost. Namely, 


y1—sin?t = cost, da PY 
dt 

—- 1 dtant 1 

2 = d = —_—S = 
PAA he BOOT cost’ dt cos?t ’ 

sint dsect sint 
Vsectt—1 =t Z 

sett I m> tani cost’ ü cost’ 


e.g. 
dt 
| Vii | “, where «= tant. 


Sometimes it is more convenient to substitute x = cost 
instead of x = sint or x = cott instead of 7 = tant; e.g. let 
us substitute « = cott in the integral 


. ,dcott At 
sint dt = — | — = — logitan#t#). 
Jya- f dt sint gl zti 
: 1 z _ 2tan $t ae oe 
Since = = tant = Itanji’ ®° tan}t = =s + Vy +1. 


Hence we find the integral 


= log(a+ Ya? +1), 


dx 
f yæ+i 
calculated previously in another way. 

Now, we shall give some other types of integrals of 
trigonometric functions, being of importance in appli- 
cations. 

The integral I, = f sin"xdz. 
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We shall give the recurrence formula. 
, . dsin™—1z 
i= =| sin”-lgdceosg = — sin” yceosg + foss e 
= —sin” -l geosgs + (n—1) f cos? xsin- gde 
= —sin” i xcosr+(n—1)I,-2—(n—1) In, 
since cos*z = ]—sin’z. 
Hence the required formula: 


n—1 


L=-—- ` sin"! gcos g -+ In- (for n>2). 


Similarly, we find 
J cosmde = + costosine+"—* f costas (n > 2). 
The integrals 


f sinmasin nade , f sinmacosnede , f cosmacosnads 


can be evaluated applying the formulae 
sin mzsinnxz = 4[cos(m—n)x—cos(m+n)z], 
sin mxcosne = ġ[sin (m +n)x +sin(m—n)e], 
cosmrcosnz = 4[cos(m+n)x+cos(m—n)x], 
known from the trigonometry. 
We find easily: 


f sinmosin ne de = 


Fh 


p [ee _ sin ie] or mx in, 


2 m— n m+n 
1 va | 
2 | 2m 


J sin mgcosngadg = 


-; |e ee tor m # bn, 
2, m+n m 
1 cos2me 


2 2m 


for m=n, 
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f cosmecosnard = 
1fsin(m+n)x , sin(m—n)x 
1 /sin2ma 
(“ge +8] for m=n, 
, dx 
The integral lasso 


To calculate this integral, we write the denominator 
of the function under the sign of the integral in the form 
csin(x+ ©). The values of c and 9 we find from the 
identity: 

csinzcos 8+ ccosxsinO = asing-+ beosz, 


i.e. 
a =ccos0, b=cesinð0, 
that is 
c=yVy@ +, O= arctan. 
We obtain 
dx _1 d(x+0) 1 z+0O 
| camara ~e) sin(e+ 0) — ge | ea |. 


Remark. In § 9.2, 5 we gave the recurrence formula 


for the integral f eee This integral may be calculated 


az’) 
also applying the formula for the integral f cos" ada. 
Namely, substituting 7 = tant, we obtain 


(ee = f cose! at = f cost—teat. 
a“ 


Exercises on § 9 
Find the indefinite integrals of the following functions: 
1. esing, 2. xe, 
3. wxsing, 4. #loga, 
5. arctang, 6. æ(loge)”, 
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1 1 
T. sin?g ’ 3; L+a%+ at’ 
vt—e+4 1 
_, = 10. = 
(2—1) (£ +2)’ jetyo 
1 1 
1. = 12. , 
ys+i— ysi’ +a 
13. n substituting y2? +c =x+t 
Vx2+e 
(cf. § 9.5, Example («)), 
14. — (m an integer), 
15 me (m an integer) 
. ae ger), 
16 ax -+b 


(Herny pe+qe+r 
Remark. Prove that if R is a rational function 
of two variables, then Riz, ya + ba +e) = W(@)+ 
U (x) 
V av? + ba +e : 
Hence deduce (by 14-16) a general method for integra- 
tion of irrational functions of second degree. 


where U and W are rational functions. 


17. cote, 18. ser, 19. sin™ cos" zx, 
arc sinav 
20. COSL: cos2a- cos3zr, 21. eer 


§ 10. DEFINITE INTEGRALS 


10.1. Definition and examples 


Let a function y = f(x) continuous in a closed interval 
a<x<b be given. By the definite integral f(x)dx from 
a to b we understand 


b 
(1) f f(w)dx = F(b)— F(a), 
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where F is an arbitrary primitive function of the func- 
tion f in the interval ab, ie. F(x) = f(x) fora <s < b, 
F'.(a) = f(a) and FL(b) = f(b). 

The definite integral does not depend on the choice 
of-the function F; this means that if G is also a primitive 
function of the function f, then 

G(b)— G(a) = F(b)—F(a). 

This follows immediately from the fact that the dif- 
ference between the functions G and F is constant in 
the interval a <a <b (cf. § 7.5, 4, Remark). 

The formula (1) will be assumed also in the case 
when b <a. Hence we have 


(2) fie jae =~ f ade 
b 

and 

(3) f f(@)de = 


From Theorem 2, of §9, 2 it follows immediately 
that every function continuous in an interval a <x <b 
b 


possesses the integral f f(x)dx, that is, as we say, it is 
a 


integrable in this interval. 
To indicate the difference F(b)—F(a), we use also 
the symbol 


[F (2) = F(b)—F (a). 


Remark. It follows from the definition that the 
definite integral depends on the function f and on the 
limits of integration. However, it is not a function of 
the variable œ (æ appears here only as a variable of 
integration). The value of the integral will not be changed, 
if we replace the variable « by another variable, e.g. t: 


b b 
f iade = f ftat. 
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b 
EXAMPLES. (a) f edx =c¢(b—a). Indeed, we have 
a 


b 
f ede =cx +0, whence f cdx = [oa = ¢(b—a). 


1 
(8) {ade =4}4, because fade = 423+, whence 
1 2 i 
J æde = [hat =}. 
ni2 


(y) J sinvdx =[— coss]? = — cos(x/2)+cos0 =1. 
0 


(5) The following definite integrals (Fourier’s, 
cf. § 11.7) are easily found on the basis of the formulae 
for the indefinite integrals (§ 9.6): if m and n indicate 
two different positive integers, then 


m n 
j sin mæsinngde = 0 = | COS MLCOSNL AL ; 
-x -r 


for arbitrary positive integers m and n: 


ag 
f sinmecosnadz = 0; 


-r 


for arbitrary positive integer m: 


ud kid 
| sim@madrs = r = Í cos meds . 
TE iy 


(e) For an arbitrary positive integer n the formulae 
n/2 
(4) | sin?" ade = 
0 


1-3-...-(2n—1) = 
Q-4-....29n 2? 
ni2 
4-...-2n 


9. 
inant pe a 
f e E WL) 


ô 
hold. 
These formulae follow easily from the recurrence 
formula (§ 9.6): 


f sin” gde = — = sinni geoss + = f sin®—adx (n > 2) 
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and from the formulae: 
1 m/e 
|- — sin™*ncose| = 0, 
n 0 
zi2 ni2 
Í sint rde =1, f sin? gde = 4r. 
0 0 


Let us note that if we replace sine by cosine, then 
the formulae (4) remain true. 


10.2. Calculation formulae 


The first three general formulae for the indefinite 
integrals (§ 9.3) lead immediately to the following three 
calculation formulae for the definite integrals (we assume 
that the functions under the signs of the integral are 
continuous in the closed interval of integration): 


b b b 
Į; POEZO = J iode J glede, 


b 


2. feroa =ef f (x) da , 


a 


3. I f(a) 9(w) da = [f (x) g(a)? — i f'(x) g(a) da. 


The formula for integration by substitution leads to 
the following formula: 
1) 


4. Jove \If'(a)da = f gly)dy 


fla) 

Namely, let G(y) be a primitive function of the func- 
tion g(y). Then (by formula 4 of § 9.3), G@[f(x)] is the 
primitive function of the function g[f(x)]f'(#). Thus, ac- 
cording to the definition of the definite integral, 


f(b) 


J gU (æ) f'ede = GU) — Gl la = f guay 


tia) 
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5. The theorem on the division of the interval 
of integration: 


c b b 
f tlayde+ f f(w)dx = f f(a)de. 


Namely, denoting by F a primitive function of the 
function f, we have 


[F (c)—F(a)]+[F(b)—F(c)] = F(b)—F(a). 
b 
6. If f(x) >0 and a<b, then f j(w)de>0 


Indeed, denoting by F a primitive function of the 
function f, we have F’(x) = f(x) > 0; hence it follows 
that the function F is increasing (in the wider sense). 

b 


So F(a) < F(b), ie. f f(x)de = F(b)— F(a) > 0. 


Formula 6 implies the following slightly more general 
formula: 


7. If f(x) <g(x) and a <b, then fie jde < J oa) az 


By assumption, g(x)—f(x) >0. Thus, by 6, we have 
b 
f (g(v)—f(x)]dae > 0, whence by 1, 
a 


b b 
f glw)de— f f(a)dx >0 


As is seen from formula 7, the relation < remains 
unchanged by the integration (when a< b). We shall 
deduce from 7 the following two formulae: 


b i 
8. fa (2) da| < Jirod, ifa<b. 
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Namely, it follows (according to 7) by integration of 
the double inequality —|f(x)| < f(x) < |f(zx)|: 


b b b 
f -lfla)|de < f fla)dx < f \f(a)|de, 


a 


b 


b 
— f |f(a)|\de < fioa < f lf(a|ae. 


Hence we get the required formula (since the inequality 
—u <v <u implies the inequality |v| < u (cf. § 1, (17)). 
9. The mean-value formula. 
ath 


Í f(x)dx = hf(a+ Oh), 


where © is a suitably chosen number satisfying the con- 
dition 0< 0 <1. 

Let F denote a primitive function of the function f, 
i.e. F'(æ) = f(x). Then we have 


ath 


f f(w)de =F (a+h)— F(a) = hF'(a + Oh) = hf (a + Oh) 
a 
according to the mean-value theorem of the differential 


calculus (§ 7.5, (f)). 


10. Let a function f be continuous in the interval 
a<a<b. Let us write 


(1) g(x) = f f(t)dt 0). 


Then the following basic formula holds: 
d z 
(2) ge) =f), ie Š f ar =sa), 


(1) It may be also written g(x) = freja 
a 
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zx 
i.e. the integral J f(t)dt, considered as a function of the 
a 


upper limit of integration, is a primitive function of 
the function under the sign of the integral. 

To prove this, let F denote an arbitrary primitive 
function of the function f, i.e. let F(x) = f(x). According 
to the formula (1) of § 10.1, we have g(x) = F(x)—F (a). 
Differentiating, we obtain g(x) = F'(x) = f(z). 


Remarks. («) At the ends of the interval of inte- 
gration we have 


g+(a) =f(a) and g-(b)= f(b). 


(8) Let us note that the function g is continuous as 
a differentiable function. 


11. If a sequence of continuous functions fanl), a <x <b, 
is uniformly convergent to a function f(x) in the interval ab, 
then the integral of the limit is equal to the limit of the 
integrals: 


b b 
(3) f f(w)dw = lim f fp(w)ae, 


b b 
ie f imfe)]de = lim f fa(w) de. 


Since the limit of a uniformly convergent sequence 
of continuous functions is a continuous function (§ 6.1, 
Theorem 1), the function f is integrable. Applying the 
formula 1 to the functions f and fn, we have 


b b b 
(4) f Hajde- f fa(w)de = f [f læ)— fale)]da . 


At the same time, because of the uniform con- 
vergence of the sequence of functions fi, f.,... to the 
function f, there exists for a given £> 0 a number k 
such that |f(x)—f,(x)|<e for n>k. Hence, by (4), 8 
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and 7, we have 
b b 
| J teyde— f frle)de| = 


b 
= | f æ= hladz| < J roha) uesia 


In this way we have proved that for n > k there 
holds the inequality 


b b 
| J twyde— f frla)de| < 


This means that equation (3) is satisfied. 
As a corollary of Theorem 11 we have: 


12. J {S nola- X f rioa, 
n=0 n=0a 
assuming the functions fa to be continuous and the series 


» fa(z) to be uniformly convergent in the interval 
n=0 
axan<d. 


EXAMPLES AND APPLICATIONS. («) To evaluate the 
1 


integral f (1—2*)"dx, we substitute «= sint. Then we 
0 
have 0 = sin0, 1 = sin(z/2). Thus (cf. § 10.1, 5), 


1 1/2 
(5) fa-era= | cose at 
0 o 
ni2 e 
J 2.4. n 
= 2n+i Z 
J cos?n+i{ dt PE T EET an Fi 
b b 
(B) lim f cosnada = 0 = lim f sinneda. 


n= q RAO q 
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Indeed, substituting y = nx, we obtain 


b nb 
f cos ncrdar = = f cos ydy = ~ (sinnb—sinna) ‘ 
a na 


b 
Since |sinnb—sinna| <2, we have lim f cosngds =0. 
n= a 


b 
Analogously it is proved that lim f sinngds = 0. 


n=0 a 


The mE more general formula holds: 


(y) lim ET =0 zim J fesinneae, 
n=0 ¢ 
where f is an arbitrary continuous function. 

Let a number e > 0 be given. According to the uniform 
continuity of the function f in the interval a <% <b 
there exists an m such that dividing the segment ab 
in m equal segments, to any pair of points x and 2’ be- 
longing to the very same from among these m segments 
the inequality |f(2)—f(x’)|<e holds. Let a, az, ..., am- 
be the points of the division; moreover, let a = a, dm = b. 
By formula 5, we have 


J fle\eosneae = x eee: 


kel Oy) 


= X fa) ETTR T Ue- {(ax)]coa nada} . 


ak1 ayy 


Thus (cf. formula 8), 


|f re)eosneae| < < Sian eee eens a), 


ak1 
because 


\f(@) —f(ax)||cosna] <|f(x)—f(ax)| <e. 
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Since, as we have proved, 
ak 
Ti ; 2 
f cosnadax| = z Sin nas — sin nay—1| Sos 
ay 
so denoting by M the upper bound of the function |f(z)| 
in the interval a <æ <b, we obtain 


J reyeosnsde| <? p em + e(b— a). 


Whence choosing n so large that 2 Mm <e we have 


b 
| f j(a)cosnade| <e(1+b—a). 


Hence the first of the equations (y) follows. The proof 
of the second one is analogous. 

(5) If the indefinite integral of a given function is 
not known but this function may be expanded in a uni- 
formly convergent series of functions which we are able 
to integrate (e. g. in a power series), then the application 
of Theorem 12 makes it possible to express the definite 
integral by a series. 

In this way we shall calculate the elliptic integral 
(cf. § 9.5, Remark): 


re /2 
T> f na u EA, 
< VY1—Ksinte 
As we know ha se He 
1 1-3-5 


=14 54+ 4+ ——— t+... (|t} <1). 


yi—e 2-4 2-4-6. 


Hence, replacing t = ksing we have: 


1 1-3 
— = 1 Ta 1 z2sin?z —— k'sin‘a 
V1—k* sin? x + i 
+ To k8sin®a +... 


2-4-6 
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This series is uniformly convergent in the interval 
0 <a2< 7/2 (even on the whole X-axis), since the series 


representing 75 is uniformly convergent in the interval 


—|k| <t<|k|. Integrating term by term and applying 
the formula ((4) of § 10.1) 


[2 


. _ 1-3... (2n—1) 
sin? yde = Sond n 


we obtain 


ref2 
f dx B 
¢ Vi—ksin?s 


T 1 1- 3\? 1-3-5\? 
= -41+ |=) k4 pa k ———} k®+...]. 
A +(5) Had cre ý | 


10.3. Definite integral as a limit of sums 


Now, we shall prove theorems which give important 
applications of the definite integral. 


1. Let a continuous function y = f(x), a Sæ <b, and 
a number e œ> 0 be given. Then there exists a number ô > 0 
possessing the following property: if the points a<a,< 
<... < Am, where a =a and dm = b, satisfy the inequality 
ar— arı < ô for each K=1,2,...,m and if the points 
Lis -Zm are chosen from the intervals agai, ..., Amım, 
respectively (i.e. ak-ı Sk S ay), then 


m b 
> f (an) (ar— Ons) — J f(a) d| <E. 


kmi 


Indeed, according to the uniform continuity of the 
function f in the interval ax<a<b (cf. § 6.4, 1) there 
exists a 6 > 0 such that the condition |z—x'| < ô implies 
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| f(x)—f(2’)| <y By the formulae 5 and 9, § 10.2, 


we R 


fioa- fro deat Tiaj 


= Aen +... + f (En) (dm — Ons) 
= >) f (wh) (ae — ar), 
k=1 


where æy is a suitably chosen number in the interval ar- a,. 

.Since the points 2, and a belong to the interval 
Q,-14, the distance between these points is not greater 
than the length of this interval, i.e. |Z — ®p| < ar— ak- <6. 


Hence it follows that |f(xx)—f(axr)| < rt Consequently 


b 


> fle) (de ar) | Heras = 
k=1 


-| Sy [f (an) — ](@%— @x—1) 


k=l 


< wy [f (Xx) — f (ak) | (Ge — akı) 


k=1 
E€ (A 


In this way Theorem 1 is proved. 


Now, let us consider instead of one partition of the 
segment ab (defined by the points a), a,,...,@m), @ Se- 
quence of partitions of this segment in smaller segments. 
Let the n-th partition be defined by the points 


Ono) Any +++) Only» Where ano = 4, Any, =b. 
Let ra denote the length of the greatest segment of 


the n-th partition. We say that the above sequence of par- 
titions is normal, if lim r, = 0. The following theorem holds: 


n= 
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2. Let a continuous function y = f(x), a <x <b, and 
a normal sequence of partitions of this segment be given. 
If the point an, belongs to the k-th interval of the n-th 
partition (i.e. Ank- S Enk Sany for k=1,2,..., ln; 
n=1,2,...), then 


b In 
(6) J iade = lim Y (2n) (ne — anr). 
a n= k=l 


Let an £> 0 be given. We choose N in such a way 
that for n > N the inequality r, < 6 holds, i. e. that all 
intervals of the n-th partition have the length <ô (where 
ô has the same meaning as in the previous theorem). 
Then by Theorem 1 we have 


ln b 
| X Fann) lant — ane) — f fade] < e. 
kal a 

This means that equality (6) is satisfied. 

It follows in particular that if all segments of the 
n-th partition are of the same length, namely, 27”(b— a), 
then 


b 2” 
f f(w)de = (b—a)lim 2” SY flans). 


n=l k=l 


b 
Remark. The notation f ydx is closely related to 


Theorem 2, so from the point of view of notions as from 
the historical point of view. The symbol f, the modified 
letter S, had to indicate the summation of infinitely 
many “infinitesimal” terms of the form ydz; this con- 
cept, which was not well-defined from the logical point 
of view, becomes now expressed strictly in Theorem 2. 
It is easily seen that this theorem represents the definite 
integral not as an infinite sum but as a limit of sums 
of an increasing number of terms. 

In § 10.11 we shall turn to the definition of the integral 
based on formula (6). 
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10.4. The integral as an area 
Let f(x) >0 for a<xv <b. 
The integral f f(x)dx is the area of the region P con- 
sisting of the points æ, y of the plane satisfying the conditions: 
a<@<b, O<y<f(z). 


It is really so, when the function f is linear. Then 
the region P is a trapezoid the bases of which (parallel 
to the Y-axis) have the length f(a) and f(b), respectively, 
and the hight has the length b—a. Thus the area of the 


trapezoid is HO) +10) ha 


On the other hand, the function f as a linear function 
is of the form f(x) = cr+d. Hence 


b 
f Hajäe = $c(b?—a?)+d(b—a) = (b—a)(4cb -+ §ca +d) 
AU i, 


since f(a) =ca+d and f(b) =cb+d. 

Thus we see that in the case when the function f 
is linear, the notion of the area known from the elementary 
geometry is equivalent to the above defined notion of the 
area as the definite integral. This equivalence holds also 
in a wider sense, if f is a polygonal function (cf. § 6.4), 
i.e. when the graph of the function is a polygonal line. 
Namely, the region between this polygonal line and the 
X-axis consists of a certain number of trapezoids and 
hence its area is the sum of the areas of these trapezoids. 
Yet since, as we have stated above, the area of each of 
these trapezoids is a suitable integral, so the area of the 


b 
whole region is the sum of these integrals, i.e. f f(x) da 
a 


(according to § 10.2, 5). 
In the general case if f is an arbitrary continuous 
function, the function f is the limit of a uniformly con- 
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vergent sequence of polygonal functions (cf. § 6.4): f(x) 
= lim},(#). Hence, by § 10.2, 11, 


n=00 


b b 
f f(w)de = lim f falæ)de. 
Then we see that the area of the region determined by the 
b 


curve y = f(x) (defined as the integral Í f(x)dx) is the 


limit of areas of polygons “inscribed” in this curve 
(cf. Fig. 10 in § 6.4). 

Thus, there is here a complete analogy to the area 
of a circle, defined as the limit of areas of inscribed (or 
circumscribed) polygons. Similarly, we define the area of 
me region P given by the curve y = f(x) as the integral 


J f(x) da. 

Remark. This area could also be defined on the basis 
of the measure theory, which we shall not consider here. 
Then this definition could be proved to be equivalent to 
the definition of the area by means of the definite integral 
(we have performed such a proof in the most elementary 
case, namely, if f is linear or polygonal). 

EXAMPLES. («) Let y = Yr—a, —r <x <r. We shall 


r 


calculate f Vr — at dx. 
-r 


For this purpose we shall find the indefinite integral. 
Substituting z=f we obtain (cf. § 9.3, 4) 


| Vraa =r | Yi-#ae = re (Jaresine + 52/12) 
1 .& iæg_/ x 
— x2] è eas ae — — 
=r (arosi +3 1 an 
Hence 


fJ yr- eds = r: (arcsin 1 — farcsin(—1)) = 4777, 


since arcsinl = 4x and arcsin{—1) = — Lr. 
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In this way we have obtained the formula for the 
area of the semicircle with a radius 7, known from ele- 
mentary geometry. 

(8) The area of the region contained between the arc 
of the parabola y = 2, the X-axis and the straight line 


a 
x =a is given by the integral f a%dax = 4a’. 
0 


2 2 
(y) The area of the ellipse {+h = 1 will be cal- 


culated as follows: the above equation gives y = b y = 


a 2 
whence the area of the ellipse is equal to 2b f 15de. 
-a 


Applying, similarly as in the example («), the formula 
for the indefinite integral f |/1—2*dz we find 


2 | y1- Ža = nad. 
a 
-a 


(5) The area between the sinusoid and the segment Or 
on the X-axis is 


n 
f sinada = [— cosg]; = 2. 
0 


(e) Let two continuous functions u(x) and v(x) defined 
in the segment a <s <b be given. Moreover, let u(x) 
< v(x) for a<a<b. The region N contained between 
these two curves, i. e. the set of points x, y on the plane 
satisfying the conditions: 


axx<b, ul@)<y<v(z) 
is called a normal region. 
b 
The area of the normal region N is f [v(x)—u(a)]dz. 


Indeed, if u(x) > 0 everywhere, then the region N is 
obtained from the region contained between the curve 
y = v(x) and the X-axis by subtraction of the region 
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contained between the curve y = u(x) and the X-axis; 
b 


the area of the first region is f v(x)dx and the area of 
a 


b 
the second one is f u(x)dx. Hence the area N is the 


difference of these integrals. 

Now, if the inequality u(x) >0 does not hold for 
all x, then we denote by m the lower bound of the 
function v in the interval a < zx < b and by N, the normal 
region defined by the curves u(x)—m and v(x)—m. The 
region V, is obtained from the region N by translation 
and so N, is congruent to N. Thus, 


b 
area N =areaN, = | {{o(x)—m]—[u(a)—m]} dx 


b 
= | (v(z) —u(a)jdz. 
a 
Remarks. («) Considering the area of the normal 
region it is meaningless whether we take its perimeter 
into account. Namely, we assume the perimeter to have 
the area 0. This follows from the fact that the curve 
y = f(x) may be included in a normal region with an 
arbitrarily small area, namely, in the region contained 
between the arcs y = f(x)+¢ and y = f(x)—e; the area 
of this region is 2e(b—a). 
(8) The symbol yd is called the element of the area 


(ef. $ 7.13). 
b 
(y) The integral f f(x)dx may be interpreted as an 


area also without the assumption f(x) > 0, if we agree 
upon considering the area of regions lying below the 
X-axis to be negative (where a < b). Thus, if the interval 
ab may be divided in smaller intervals in such a way 
that in everyone of these intervals the function is either 


everywhere nonnegative or nonpositive, then Í f(a)da is 
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the algebraic sum of the areas defined by the ares of 
the curve y = f(x), in each of these intervals separately. 

For example for the curve y = sing, 0 <z < 2n, we 
divide the interval 0, 2x into two halves. The sine curve 
together with the interval 0, x of the X-axis gives a region 
with an area 2 and together with the -interval z, 27, 
a region with an area —2. The algebraic sum of these 
areas equals Q, i.e. 


27 
f sin gdz = 0. 
0 


(è) Interpreting the definite integral as an area, many 
of the previously proved theorems become of a clear 
geometrical content (especially, if the function under the 
sign of the integral is nonnegative); e.g. Theorem 9 
of § 10.2 means that the region defined by the arcy = f(x), 
a<xa<b, the X-axis and the perpendicular segments 
lying on the straight lines x = a and æ = b has the same 
area as a rectangle having the segment a <x <b as the 
base and the ordinate of a suitable chosen point on the 
arcy = f(x) a<x< b, as the height. 

It follows from Theorem 10, of § 10.2 (cf. remark (8)) 
that the area of a region defined by the arcy = f(z), 
@<2£ <2’, varies continuously together with 2’. 

Theorem 11 of § 10.2 means that if the functions fn 
are uniformly convergent in an interval ab to a function f, 
then the areas of the regions defined by fn are convergent 
to the area of the region defined by f. 


10.5. The length of an arc 


Let a function y = f(x), a < x < b, having a continuous 
derivative f'(x) be given. The integral 


(7) fy 1+ (Z ae 
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gives the length of the arc formed by the points v, y 
satisfying the conditions 


(8) y = f(x), aud. 


It is indeed so, if f is a linear function, i.e. if the 
considered curve is a segment joining the points [a, f(a)] 
and [b, f(b)]. The length of the segment is equal to the 
distance of its ends, i.e. 


y (b—a?+[f(b)—f(a)P. 
Applying the integral we obtain the same result. 
Namely, let us write f(z) = cx+d. Hence f(c) = ¢. Thus, 
b 


f Vi+@dx = VIF è (b—a) = y0 — aF +0) aÉ, 


a 
since 
o 10-i 

b—a 

In the general case (if we do not assume the linearity 
of the function f) we find the explanation of the above 
assumed definition of the length of an arc in the following 
construction. 

We know (cf. § 6.4) that an arc of a curve given by 
the conditions (8) may be approximated by polygonal 
lines inscribed in this are (cf. § 6.4, Fig. 10). Now, we 
shall prove that, denoting by L the length of this arc 
expressed by the integral (7) and by Lı, L,,... the length 
of the successive polygonal lines, we have 

L = lim Ln. 

Namely, let the n-th polygonal iine be obtained by join- 
ing the points Lano; f(@n,0)]; [4n,1, flan), csuj [Ontn y (@n,t,)] 
by segments, successively, where ano = @, anı, =b and 
the length of the greatest interval of the n-th partition 
tends to 0 as n tends to oo (i.e. the sequence of these 
partitions is normal in the sense of § 10.3), The length 
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of the n-th polygonal line is the sum of the length of 
the particular segments, which constitute this polygonal 
line, i.e. 


ln 
TF > (an, — ank1)? + [f (ank) — Í (ank1). 


Applying the mean-value theorem we obtain 


ln 
In = D>, (Ane anx- 1) \ V1 HES (aw)? 
k=1 
where  @n,k—1ı S Wak S Ank » 


Hence by Theorem 2 of § 10.3 (formula (6)), we conclude 


after substituting Y1+[f'(x)? in place of the function f(z) 
that 


b 
{ VIFT Pde = lim n= L. 


The remarks noted in the case of the definition of 
the area are valid in the case of the definition of the 
length of an arc, too. The notion of the length of a curve 
may be defined on the basis of the general measure theory 
and it may be proved that for arcs of the form (8) this 
definition is consistent with the definition given here by 
means of the integral (7). However, since we do not use 
here the measure theory, we define the length of the arc 
(8) as equal to the integral (7). 

The approximation of the length of an are by the 
length of inscribed polygonal lines which we have con- 
sidered above is the generalization of the approximation 
of the length of a circumference by the perimeters of 
the inscribed polygons, known from the elementary geo- 
metry. We shall prove that the length of an arc of the 
circle in the sense of elementary geometry is equal to 
the length in the sense of the definition assumed here. 


EXAMPLE. Let y = pr?—2*, reosB <æ <reosa (0< a 
<< x). The considered arc is a part of the semicircle 
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with the radius r and the centre 0. Let us calculate the 
integral (7). We have 


Ne ae whence X de PLLA 
Vr’ J VIFO =| oe 


Substituting v = rcost we find 


i raa = —ri =—rarecos~. 
ye 7 
Hence 

rcosa 

| ViF@Fae = (b -a)r 

rcosß 


in accordance with the formula known from elementary 
geometry. 
Let us write 


s(a) = | VIFF OP. 


The function s(x), i.e. the length of the are treated 
as a function of the abscissa of the right (varying) end 
of the arc is an increasing function. Thus, there exists 
a function x = x(s) inverse to s(x), which represents æ 
as a function of the length of the arc. There hold the 
formulae: 


ds dy dx 1 


2 
(9) iG 1+ (2 and Tay 
7 dx 


Denoting by a the angle between the tangent to the 
curve and the X-axis, we have ov = tana and so - 
= cosa. This means that the derivative is the direction 
cosine of the tangent to the curve y = f(x) with respect 
to the X-axis. 


This follows also from the fact that 


, do , (dy\* _ 
22 =— —=tana-cosa=sina and (a) +(2) = 
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Remark. The “length element” may be symbolically 
represented analogously to the Pythagorean formula: 
ds? = da? + dy’, being of a clear geometrical content (cf. the 
notion of the differential, § 7.13). 


The curvature. Let us denote as previously by a 
the angle between the tangent and the X-axis. This angle 
is a function of æ; considering xz as a function of the 
length s we express a as a function a(s) of the variable s. 


The derivative k = “a is called the curvature of the 


&o Gp 


Fic. 23 


curve y = f(x) at a given point, the inversion T =e Is 


called the radius of curvature. 
Geometrically, the curvature k is interpreted as follows: 
Let us draw the tangents to the considered curve at 
the points 


Po = [@(8), ¥(8o)] and p,=[@(8ot+h), ¥(8+h)]. 


The angles between these tangents and the positive di- 
rection of the X-axis are ag = a(s)) and a, = a(s+h), 


246 IV. INTEGRAL CALCULUS 


respectively. The angle 6, between these two tangents is 
@,—a. This is the same angle as the angle between 
the normals to the curve at the points pọ and Ppr. Let 
us consider the quotient of this angle by the length of 
the arc Pph, i.e. by h. The curvature of the curve y = f(z) 
at the point p, is the limit of this quotient as h tends to 0. 

In particular, if our curve is an are of the circle 
y = Vr =, —r<a2<r, then h = —ré, and so the con- 


sidered quotient has the constant value B Thus the 


same value has the curvature k, and the radius of the 
curvature is equal to the radius of the circle. 

In the case of a straight line the normals are parallel. 
Thus 6, = 0 always and the curvature is equal to 0; hence 
the radius of the curvature is infinite. 

If k #0, then the point lying on the normal in the 
distance 9 from the point p,on the same side of the tangent 
on which the curve lies locally, is called the centre of 
curvature. We may prove that this point is the limit 
position to which the point of the intersection of the 
= normals at the points p, and pa tends as k tends to 0. 
The curvature k may be expressed in the coordinates x 


and y as follows. Taking into account that a = arctan (74) 


and basing on formula (9) we obtain 


ad?y 
da dade da 4 
ds dx ds — (dy\? dy)?’ 
+ (a) 1+ (aa) 
i.e. 
dy 
ax? 


ear 


The centre of mass. Let a system of n material 
points with the coordinates (£1, Y1); ++) (Zns Yn) and with 


(10) 
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the masses m,,..., Mp be given on the plane. The centre 
of mass of this system is the point with the coordinates 


M Li +... + Mn Ln MYI + e+ Mn Yn 


11) Z= J = 
(1): MH. HM ’ Y M,+...+Mn 


To define the centre of mass of an arcy = f(z), 
a < {x <b, with a constant density g we proceed as follows. 
Let us represent v as a function of the length s, i.e. x = x(s) 
(as above); hence y = f[æ(s)] = y(s} Let S denote the 
length of the arcy = f(x), a <æ <b. Let us divide this 
arc into n equal parts. This division constitutes a partition 
of the interval 0S into n equal intervals; let the points 
of the partition be 


0 = 8n,05 Sn,1; ..:}9 Sn,n = S . 


The point with the coordinates &®(Sn,x), y(8nx) is the 
end of the k-th arc of the n-th partition; the mass of 
this arc corresponds to this point. This mass is the product 
of the density by the length of the arc, i.e. it is equal to 
9° (Sn,e—Sn,k—1). Thus given n, the centre of mass of the 
system of points 


[8 (Sn,1); Y (Sna); a] [2 (Snn); Y (Sn,n)] 
is the point with the coordinates 


n 


1 : 
Tn = 9 L(Snjk) (Sn, — Sn,k—-1) 3 


1 
Yn = 8 2 Y (Sn) (Sn,k — Sn,k-1) » 
since the mass of the arc is equal to gS. 
The limit position of the point (£n, Yn) as n tends 
to oo is the position of the centre of mass of the con- 
sidered arc. Thus the coordinates of the centre of mass are 


Ss S 
(12) @=lima,= {ads and g=limy,=5 | yds. 
5 n=% ó 
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10.6. The volume and surface area of a solid of revolution 


Let a continuous function y = f(x), a <a < b, be given. 
Moreover, let f(x) >0. Let us denote as in § 10.4 by P 
the region constituted by points x,y satisfying the con- 
ditions a <z <b, 0 < y < f(x). Rotating the region P 
around the X-axis we obtain a solid of revolution. Let 
us denote its volume by W. We have 

b 


(13) W=nr f yeda. 


In order to explain this formula, let us consider 
a normal sequence of partitions (see § 10.3, 2). Let 


Fig. 24 


(Ene) be the upper bound of the function f in the 
interval an,k-1; ank. Replacing the arc of our curve lying 
over this interval by the segment y = f(%n,) we obtain 
by the rotation around the X-axis a cylinder with the 
base rf(£nx) and with the height ¢,,—a@,,%-1, and so 
with the volume 


Tf (Ln, x)? (an,k — ank1) » 


Proceeding in this way for each k (n being constant) 
we replace the considered solid of revolution by another 
one, circumscribed on the given solid and made up of 
a certain number of cylinders. The volume of this solid 
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is the sum of the volumes of the particular cylinders: 
denoting this volume by Wn, we have then 


ln 
Wia=nt > f (Ene)? (ank — In,k—-1) . 


k=l 
By Theorem 2 of § 10.3 we obtain in the limit 
wW == lim Wa . 


næm 


Analogously, replacing the upper bound by the lower 
bound in the above construction we prove that W is 
the limit of the volumes of certain solids inscribed in 
the considered solid of revolution everyone of which is 
a sum of a certain number of cylinders. 

Let us denote by B the area of the surface obtained 
by the rotation of the arcy = f(x), a <x < b, ie. the 
area of the lateral surface of the considered solid of revo- 
lution. We have the formula 


b 
(14) B =2r | yy1F y Fd 


(assuming the continuity of the derivative f’(z)). 

To establish this formula we approximate the con- 
sidered surface by surfaces the area of which is known 
from the elementary geometry. For this purpose let us 
consider a sequence of polygonal lines approximating the 
arcy = f(x), a <x <b, defined in § 10.5 (cf. Fig. 10). 
The surface obtained by the rotation of such a polygonal 
line around the X-axis constitutes of a finite number of 
truncated cones. Since the generator of a truncated cone 
is the segment joining the points [@n x-1, f(@n,4%-1)] and 
[ancy f (än x)], i.e. a segment of the length 


y (On — An,k-1 Ng + [f (ank) sS f (ank~), 
and the radii of the bases are of the length f(a,,) and 


f (ank~), respectively, so the area of its lateral surface 
is equal to 


TEP (an, x-1) + F(Gne)] -© V (One — ank1)? + [f (anx) —F(Gne—i) Py 
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as follows from a formula known from elementary 
geometry. 

Hence, denoting by B, the area of the surface obtained 
by the rotation of the n-th polygonal line, we get 


ln 
Bn = > Cf (anes) + f(4n4)] 


k=1 


(an,k— On,k—1)” + [f (an) — f(Gne-1) PF = 


=n y Cf (net) +f (dne)]-VI FP Enk) ane — ner) 5 
k=1 

where Gnn—1 S Lnk S An,k- 
We shall prove that 

(15) B = lim B}. 


n=% 


For this purpose let us compare B, with 


ln 
Cn = 2r > f (Enk) : V 1 + [f (2n, k) P( Qn ke T An, k—1) . 


k=1 


By Theorem 2 of § 10.3 with the function f(x) replaced by 
the product f(x)-V1-+[/(z)P we conclude that B = lim C,. 


N=00 
Thus it remains to prove that lim (B,—C,) = 0. 


n= 


Now, 
ln 

By—Cn =r X (f(Ane—1)—1 (Enr) +f (ant) — f (me) 1- 
k=1 


-VIF U Enk) Pane — âne) - 


According to the assumption that the considered sequence 
of partitions of the interval of integration is a normal 
one we may assume that if the points x and wv’ belong 
to the same interval of the n-th partition, then |f(x)—f(#’)| 
<e (where e is a given positive number). Thus 


|f (an, k—1)— Í (Enk) l <E and |f (anx) — Í (£n,k)| LE. 
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Denoting by M the upper bound of the function 


V1+[/(z)P? in the interval ab we obtain immediately 
|Bu—Cn| < 2xeM(b—a). Hence lim (B,—C,) = 0. 


n=0co 

In this way the formula (15) is proved. 

A simpler formula for the surface of a solid of re- 
volution is obtained treating x as a function of the length 
of the arc, similarly as in § 10.5. Namely, applying the 
first of equalities (9) we have 


b S 
(16) B=2n | yyI Fy Pår=2r f yds, 
a 0 


where S denotes the length of the arcy = f(@), a <s <b. 
Formula (16) may be transformed as follows: 


S 
(17) B=S.2n5 | yds = 8-277, 
0 


where ¥ denotes the ordinate of the centre of mass of 
the arcy = f(x) a< æ< b (ef. (12)). 

In other words, the area of the surface obtained by 
a rotation of the arc y = f(x) around the X-axis is the product 
of the length of this arc and the path of the centre of mass 
(Guldin’s theorem). 


EXAMPLES. («) A cylinder. Let f(x) be of a constant 
value r for 0< «<< h. The region P constituted by the 
points x, y such that O<s< h and 0<y<r is a rec- 
tangle. By a full rotation of this rectangle around the 
X-axis, a cylinder with the height h and with the radius 
of the base r is obtained. Hence the volume of this 
cylinder is equal to xr?h. The same result will be obtained 
applying formula (13), since 


h 
W = nf rdw = xrh. 
0 
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The formula (14) gives for the lateral surface of 
the cylinder (taking into account that y’ = 0) the formula 
h 


B=2n f rds =2nrh, 
0 


in accordance with the known formula from geometry. 


(B) A cone. Let y= cx, 0O<a<h. In this case the 
region P is a triangle. By the rotation, a cone with the 
height h and with the radius of the base r = ch is obtained. 
By formula (13) the volume of this cone is equal to 


h 
x | eade = broth? = hrrh. 
0 


According to formula (14) the lateral surface of the cone 
is equal to 


h 
Qn f cei +ede = noky i+ e= nrl, 
0 


where JI denotes the length of the generator (because 


l=hyl-+c*). 

(y) A sphere. Let y = Yr—2, —r<acr. The set 
of points defined by these conditions is a semicircle. 
Rotating the semicircle around the X-axis we obtain 
a sphere with the radius r. The volume of this sphere is 


n | (?—a)de =n f dx—n f atdx = 2—3 nr = grr. 
-r -r -r 


To evaluate the surface of the sphere, formula (16) 
may be applied. For this purpose we express y as a func- 


tion of the length of the arc s, i.e. y = rein =. We obtain 
the following value of the surface of the sphere: 


nr kid 


an | rsinŽds = 2m? | sintdt = 2mr[—costh = 47e. 
0 0 
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10.7. Two mean-value theorems 


FIRST THEOREM. Let two continuous functions f and 
g be given in an interval a<2<b. Moreover, let the 
function g be of a constant sign. Then 


b b 
(18) f tla)g(a)de = f6) f glw)ae, 


where £ is a suitable chosen value satisfying the condition 
a<&<b. 


Indeed, let m and M indicate the lower and the upper 
bound of the function f in the interval a <v < b, 
respectively. Then we have 


m < f(x) < M 
for every 2. 


Let us assume that g(z2) >0 everywhere. Multiplying 
the above double inequality by g(#) we obtain then 


mg(x) <f(x)g(") < Mg(z) 
and hence, by integration (cf. § 10.2, 7), 


b b b 
m f gleja < f f(a)gla)de < M f g(w)ae. 
Hence we conclude (assuming the function g to be 


not identically equal to 0, which can be obviously sup- 
posed) that 


b b 
m <{ f t(a)g(a)de: f g(æ)da} < M. 


According to the Darboux property of the function f 
(which is a consequence of its continuity), this function 
assumes all values contained between m and M. Therefore 
there exists a & in the interval ab such that 


b b 
f) = f Fæ)g(æ)da: f gijda, 


i.e. that formula (18) is satisfied. 


254 IV. INTEGRAL CALCULUS 


In the case when g(x) < 0 everywhere, the proof is 
completely analogous. 

Remark. Assuming that g(x) 4 0, always we obtain 
a shorter proof of the above theorem applying the Cauchy 
theorem stated in § 7.5, (12). Let us denote by H(x) the 
primitive function of the function f(x)g(z) and by G(s) 
the primitive function of the function g(x). Then we have 


H(z) = f(x)g("), G(x) = g(a), . 
b b 
J ta)g(a)de = H(b)—H(a), f g(a) de = G(b)—G(a). 


By the Cauchy theorem, 
H(b)—H(a) _ H'(é) _ flég(é) 
G(b)—G(a)  G@'(¢) g (È) 

and formula (18) follows. 

SECOND THEOREM. If the function f is continuous and 


the function g is monotone and possesses the second 
derivative continuous in the interval a <æ <b, then 


= f ($), 


b 
(19) f f(x) g(x) de = alo) ff) )da + g(b) i f1 de, 


where È is a suitable chosen value belonging to the interval ab. 


Let us denote by F(x) a primitive function of the 
function f(x), ie. F’(x) = f(x). Since the derivative of 
a monotone function is of a constant sign (cf. Theorem 2 
of § 7.7), so we may apply the first mean-value theorem 
to the product of the functions F(x) and g'(x). Hence, 
pe oa the rule for integration by parts, we obtain 


fi f(x) g(a) dx = J g(a) F'(x) de = [g (a) F (2) — i F(a) g'(a) dx 
b 
= [g(b)F(b)— g(a) F(a)]—F(é) f g'(x)a 
= g(b) F(b)—g(a)F(a)— F(é)g(b) + F(é)g(a) , 


b 
since f g’(a)dx = g(b)— g(a). 
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Consequently, 


Í erovwyas = g(a)[F(é)—F(a)]+9(6)[F(6)—F(4)], 
ues we obtain formula (19) taking into account that 
F(&)—F(a) = f iiae and F(b)—F(é) = fea ; 

EXAMPLES — APPLICATIONS. The mean-value theorems 


are often applied in order to estimate the value of integrals. 
We shall consider some of their applications. 


(a) Let 0<a<b. We shall prove that 


b 
(20) lim I se P = 0. 
n=% x Ki 
For this purpose we shall prove that 
b 
(21) | f ae) <5, if e>0. 
i g ca 


We apply the second mean-value theorem substituting 
f(x) = sinex and g(a) = 1/x. We obtain 


b . é b 
I a == f sinesdo+ 5 f sin cædaæ 
a a é 


£ 


1 1 
=e. (cosca— cosc) + ie (cosc&— coseb) . 


Since |cost| <1 and a< b, we conclude that 


b 
sincs 2 2 4 
gipa 
J x te] <Ž +É. 


The formula (21) implies the formula (20) immediately. 

Remark. The formula (20) is also an immediate con- 
sequence of the formula (y) in § 10.2. 

(B) Applying the first mean-value theorem, the Taylor 
formula may be deduced in the following way. 
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We substitute in the formula 
f zy™t) da = ay™) — aye) +. + (—1)r2try + 
+ (=i f "+y da 


proved in § 9.3, 5, (y), z = (b— æ)", y = f(x), assuming the 
function f to possess a continuous »+1-th derivative in 
the interval a < æ <b. 
Integrating from a to b we obtain 
b + 
f bay" de = bay nay +... my? 
a 


= n!f(b)— ((b—a)"f™(a) + n(b— a f(a) +... + n! f (a)}. 


On the other hand, the function (b—z)” being of 
a constant sign in the interval a <æ <b, we obtain by 
the first mean-value theorem 


b 
f bay) aon 


3 — g\@rtnD 
= f(g). I (b—a)"de = © ah — ae Ge 


Comparing the obtained formulae we get the Taylor 
formula with the remainder in the Lagrange-form. 


10.8. Methods of approximate integrations. Lagrange inter- 
polation 


Given n +1 points To, Z1, ..., Zn on the X-axis and n +1 
values Yo, Y1, -s Yny there may be defined a polynomial 
w(x) of the n-th degree assuming at these points the 
values Yo, Yi, +++) Yny i.e. such that 


(22) way) =y for k=0,1,..,n. 
First we shall define for each k a polynomial 1;(7) 


of n-th degree with the property that ,(7,) =1 and 
U,(2m) = 0 for each m Æ k. 
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Namely, we write 


noe ad e ee ea ee 
(Er — Lo) -° (Lk — Le—1) (Le — Ter) + e+ (We— En) ` 


By means of the polynomials u(x), we define the 
polynomial w(x): 


(23) W(L) = YoUg(L) + YU (L) +... + Yn Uns) « 


We see at once that this is a polynomial of the n-th 
degree, satisfying the condition (22). This is the so called 
Lagrange interpolation polynomial. 

It is worth while noting that the polynomial w(z) is 
determined uniquely, i.e. if a polynomial w of n-th degree 
satisfies the condition (22), too, then it is identical with w; 
for their difference is a polynomial of degree <n vanishing 
at n+1 points (namely, at the points So, Liy ..., Ln). 

When a function expressing a relation between certain 
physical quantities is known only in an empirical way, 
i.e. if only a finite number of values of this function 
(by means of measurements) is known, then an ap- 
proximate evaluation of the integral of this function is 
applied, e.g. the Lagrange interpolation, and then the 
integral of the obtained polynomial is evaluated. 

We obtain an especially simple formula if n = 2 and 
Ly = a, Dy = a £ = b, i.e. when we draw a parabola 
through the given three points. As can be easily calculated, 
we obtain 


b 
b— 
(24) if w(x) de = =" (Yo + 49, +t). 


This is the Simpson foimula giving an approximate 


b 
value of the integral f f(x)dx. The approximation will 
a 


become more accurate if we divide the interval ab into 
smaller intervals and if we apply the Simpson formula 
to everyone of them. Namely, dividing the interval ab 
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into 2n equal intervals by means of points £o, Lis ..., Yen, 
where Zo = 4, 2» =b, we obtain the general Simpson 
formula for the approximate value of an integral: 


a 
6n [Yo t+Yon +2(Ya+Ye +- +Yen—2) +4 (Y1 HY +- +Yen-1)]- 


EXAMPLE. Let us apply the Simpson formula to evaluate 
log2 = f = dividing the interval 1 < v < 2 into halves. 
We have 

T=1, Y=1, M=15, yı = 0.667..., 

%=2, Y,=0.5. 
Thus formula (24) gives the approximate value of log2: 
1(1+4- 0.6674 0.5) = 0.694... 


Actually, we have log2 = 0.6931... 

Now we shall mention the so called “trapezoid method” 
of the approximate evaluation of the integral of a func- 
tion f(x) > 0 in an interval ab. We divide the interval ab 
into n equal intervals by the points a < %1 < ... < a, 
where x) = 4, Xn = b and we draw a polygonal line through 
the points (£k, Yk), where k=0,1,...,” (ef. Fig. 10). 
The area 8, between this polygonal line and the X-axis 
is the sum of areas of n trapezoids 7,,..., Tn, where the 


area of the trapezoid Tp is equal to i -4 (Yr + Yk). 
Thus, 


b—a, 
Sn = “hn (Pinty+ vet Yn-1 + su . 

This is the approximate value of the area between 
the curve y = f(z), a <x < b, and the X-axis; speaking 
otherwise, this is the approximate value of the integral 


b 
Í f(x) de. 
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10.9. Wallis formula (1) 
We shall prove the following formula: 
. lf 2-4-...-2n P 
(25) " = lim (iy tr) 


We shall base our proof on the formulae 


ii 1-3-...+(2n—1) 
+9 = © De ooe?® n— T 
J aedo 2A om 9? 


nj 
| sin2*+1y dae = 
0 
proved in § 10.1, 5. 
From these formulae it follows: 


2-4... 2N 
3-B-..-(2n+1)’ 


26 
ao 24m \ a gp 3 
N foe eee I a in2n : f sinem ) 
2 Cremer on +1 (J a oor eit ad 
We shall prove that 
1/2 ni2 
lim { f sing dao: | sinag dar} = 1; 
nee 0 0 


Indeed, in the interval 0<x< 7/2 we have the 
inequalities 
0 <sin®+1y < sina < sin®—1z, 
whence 
n/2 n/2 ni2 
0< f sin™+2de < f sinmedr< f sin™—2de 
0 0 0 


and so 
m/2 nj2 


1< f sin? gde: f sin2"+1 ada 
0 0 
n/2 r/2 


< | sin?” gyde: | sin?” +i yde < PREI =1+ 4 ‘ 
F F 2n 2n 


(?) John Wallis (1616-1703), an English mathematician. 
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Thus the considered quotient of integrals tends in the 
limit to 1. 

Hence we conclude by (26) that 

T : 2-4-...-2n \2 1 

(27) 2 ae ia rl : 

This formula gives formula (25) immediately, since 
lim —”— = 2 
am iT 

Remarks. («) We apply the Wallis formula also in 
the following form: 

1292 
(28) ER E 
n=œ y n (2n)! 
Namely, we have 
2-4-....2n =n!-2", 
T i 1-2-...:2n _ (2n)! 
ia A sn a 

Substituting the above formulae in formula (25) and 
taking a square root we obtain equality (28). 

(8) The Wallis formula may be written also in the 
form of an infinite product: 


(29) E E Siler ace s 


n=1 

Namely, denoting by p, the partial product 
te E aa =(75 ee ids SOOO iL 

Pa SF U mei ~ 13) nT nF 
= 2-4-..:20 P 1 

~ AL-3-0.-(Q2n—1)/ 2n +1? 


we have, according to (27), lim pa = 5 . At the same time 
N= 


oo 


: 4n? 
imps = | | gas? 
RS n=1 


whence the formula (29) follows. 
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10.10. Stirling formula (?) 


We shall deduce from the Wallis formula the following 
formula due to Stirling: 


. n! 
en) a Vannnre-" 
Let us write 
n'e” 
T m yn 
So it is to be proved that lim a, = y?r. 


n=00 
First we shall prove the sequence @, @a,... to be 
convergent. Since it is a sequence of positive terms, it 
suffices to prove that this sequence is decreasing, i.e. that 


An 
On+1 


>1. Now, 


An 1 (n +1 )etitie Hha ee 
n ? 


any © MHR(ntl) e 
whence 
an fna? i) 
log PD (n+ 5)tog(1 + z) T, 


Since (ef. § 7, (54)) 


a rae 
(5+ 5)loett +a)>1 
for 0 < x < 1, so substituting 7 = = we find 


1 1 ; 
(n+ 5}log (1 +=) >1, Le. log =t > 0, 


whence T 
An+1 
Thus, the sequence a, &z,... is convergent. Let us 
write lim an = g. We shall prove that g + 0. 
nmo 


(1) James Stirling (1692-1770)—noted Scottish mathematician. 
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For this purpose let us note that 


els) - f Z< ihh). 


since the arc of the hyperbola y = zy” <a<n-+1, lies be- 


E 


si 1 
l i i a 
ow the segment joining the points (n 3) and (n +1, F E 
Hence 
an 1/1 1 
eG = 4 G- n =) 
and so 


a 1 j l4 
log ae ie. Gy > eis, 

It remains for us to prove that g=Y2n. To this 
end we now apply formula (28) taking into account the 


equations 


1)2 e2n | on 
a = (n!en and den = (2n)! ; 
nern (2n)*y/2n 
We obtain 
g? y2r 
yr = lim —=, ie g=Yy2n. 
n=% lon" a gy2 i 


Remark. The practical importance of the Stirling 
formula is based on the fact that for large values of n 
the expression Y2nnn"e-" gives an approximate value 
of n!. We say that it is an asymptotic value of n! (which 
means that the quotient of these two expressions tends 
to 1). 


10.11*. Riemann integral. Upper and lower Darboux 
integrals 
The theorems of § 10.3 are the starting point for 
a generalization of the notion of a definite integral to 
certain classes of discontinuous functions. For this purpose 
we shall introduce the Darboux integrals. 
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Let a bounded (but not necessarily continuous) func- 
tion y = f(x), a < x < b, be given. Moreover, let a sequence 
of partitions of the interval ab into 2” equal parts 
(n = 0,1,...) be given. Let us denote the points of the 
n-th partition by 

Gino) Ani) 3 Ono, Where ano=4, Onon=b. 

Let M,, denote the upper bound of the function f 
in the interval a,,~14n,. Finally, let 

Qh 
(31) ee = D>, Mar: 
k=l 

The sequence {Sn} is a decreasing sequence (in the 
wider sense). Indeed, for each k = 1, 2,..., n the intervals 
On41,2k-24n41,0%K—-1 INA Anti 2k-14n+12k are contained in the 
interval an,k—1ıä&n,x- Thus, 

Mnsijor-1< Mne and = Mnasioxr < Max, 


i.e. 
$(Mn+1,2k-1 + Mnss,2%)< Mn . 
Hence 
Sri = 
2 ee fo cee Tarnais Tina) < Sa. 


Thus the sequence {Sn} is non-increasing. It is simul- 
taneously a bounded sequence, since, denoting by m 
the lower bound of the function f, we have obviously . 
Sn >m(b—a). Hence it is a convergent sequence. Its limit 
is called the upper Darboux integral and denoted by 
the symbol 

b 
(32) f f(x) da = lim Sn. 
a TSO 

Similarly, denoting by Mp, the lower bound of the 

function f in the interval a,,-14,,, and writing 


b—a z 
(33) Sn = E > Mak 


k=l 
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we prove the sequence {s,} to be increasing (in the wider 
sense) and bounded, and so convergent. Its limit is called 
the lower Darboux integral and is denoted by the symbol 


b 
(34) f f(x) de = lims. 
a n= 
If the upper and lower integrals are equal, then the 
function f is said to be integrable in the Riemann sense; 
the common value of these two integrals is called the 
Hemann integral of the function f and is denoted by 


Í f(a)da as in the case of the definite integral of a con- 


tinuous function. The same symbology may be applied, 
because (as follows from the theorem 2 of § 10.3 im- 
mediately) the Riemann integral of a continuous function 
is equal to the definite integral of this function (in the sense 
of the definition given in § 10.1). 

The functions integrable in the sense of Riemann 
consist of a larger class of functions than the continuous 
functions. In particular, bounded functions having a finite 
number of points of discontinuity (we shall turn to such 
functions in § 11) and monotone functions are integrable. 
However, there exist (bounded) functions nonintegrable 
in the sense of Riemann. An example of such a function 
is the Dirichlet function which we have already met 
(cf. $ 4, 5), equal to 1 in rational points and to 0 in ir- 
rational points; for this function we have always Sn = 1 
and 8s, = 0 and so 


b b 
f f(w)de =1, f f(a)de =0. 


Let us add that there exists a definition of the 
(Lebesgue) integral which ascribes the integral to a larger 
class of functions than the Riemann integral (?). 


(?) Cf. S. Saks, Theory of the Integral, Monografie Matema- 
tyezne, vol. 7 (1937). 


10. DEFINITE INTEGRALS 265 


We based the definition of the Darboux integrals on 
the consideration of a sequence of the “diadic’’ partitions 
of the interval of integration. We shall now show that 
the same result is obtained considering an arbitrary normal 
sequence of partitions. More strictly, we shall prove the 
following theorem: 

Let a normal sequence of partitions of a segment ab 
defined by the points 


(35) ano< ana <- < anin, Where Gno=G, Any, =b 


be given. Let Mpx denote the upper bound of the function f 
in the interval anx—1dnx,n and let 


ln 
(36) Sh = X Minn (ah k — ahei). 
k=l 
Then 
5 
(37) lim S, = f f(a)de. 
nao a 


The proof of this theorem will be based on the follow- 
ing lemma: 
Let two partitions of the interval ab, 


=< q<..<4=b and a=y<a<...<ay=b 


be given. Let d and d’ indicate the length of the greatest 
interval of the first or of the second partition, respectively. 
Let M, and Mj, denote the upper bounds of the function f 
in the intervals a,-\a, OF ak-1āk, respectively, and let 


F r 
(38) S= Ò Mla—ar) and S'= 3’ Milak ai). 


k=1 k=l 


Finally, let the number M satisfy the inequality M > |f(a)| 
for every x belonging to the interval ab. 
Then the relation 


(39) S’<8+3r Md’ 
holds. 
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The intervals of the second partition may be classified 
in r+1 classes; a given interval of this partition will 
belong to the k-th class (for k = 1, 2,...,7), if it is con- 
tained in the interval a,_,a, and to the r+1-th class, 
if it is contained in none of the intervals of the first 
partition, i.e. if it contains inside one of the points 
Qi, Mg, «+5 U1. It is clear that some of these classes may 
be empty. 

If the k-th class (for k <r) is non-empty, then let 
Py denote the first and 7, the last index 7 satisfying the 
condition ap- < a; < ag. Since for the intervals a;_, aj of 
the k-th class there holds the inequality M; < Mx, so 
denoting by J" the sum over all intervals of the k-th 
class we have 


J" Mila; ats) < Mr X (ah— ats) = Milai, — an) 
= Milar ~ ar) —Mi( ap, — ay—1) — Mrlar— az) 
< Mr(ar— arı) +M (ap, — arkı) +M (ax — 4},) 
< Mgrlak— arı) 2M. 


If the k-th class is empty, then let X” = 0. Finally 
let us note that there are at most r—1 intervals of the 
r+1-th class. Thus, 


Dy Mika ain) <(7-1) Ma’. 
Consequently, 
S = SY Mila ai) t.t D Mila aia) 
+ DH Mila; aim) <I (ea) +- + 
+M,(a,—d,~,) + 2r Md +(r—1) Ma, 


whence the formula (39) follows. 
Thus our lemma is proved. 


In order to prove the theorem let us consider an € > 0 


b P 
and let us choose an index q such that S, < f f(x)dx +e. 


a 
Since the considered sequence of partitions is normal, 
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we have d,< for sufficiently large n. Hence, 


E 
3-2 M 
according to the lemma, we have 


b 
Si, < Sy +3-2°Mds, < f f(w)de+ 2e. 
a 


Moreover, let us choose n each n an index j, such 


a 
sa H holds. Then 


< S+ 3 urs A < Bate, 


that the inequality —— oS 


Nia S 


whence 


b ò 
J iode < Sate, because f f(@)da < 8n. 


Consequently, 
i f(a)da < Sn +e < j f(x)dx+3e. 


The number e being arbitrary, this inequality implies 
formula (37). 

Thus, our theorem is completely proved. There is 
a similar theorem for the lower integral. 

The following formula is an important consequence of 
our theorem: 


ò 
froi = f toas f roa, 
(40) 


b 
[oan = f eae f Hayao, 
ifa<c<b. i j 


Indeed, let us divide the segments ac and cb into 2” 
equal parts. Let us denote the points of the partition by 


(41) a= ano < On,1 em Anon = 0 = 
SE bn, < baa < eee < bnon —= b $ 
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Let M, « denote the upper bound of the function f 
in the interval a,,-14,, and Pux the upper bound in 
the interval bn k-1bn,x. Then we have 


i f(a) dx = lim 5 Halo haa 


nm kml 
and 
i f(x)dx = lim 5 Prax(On,n— bn,k-1) - 
n= km] 
Moreover, 
b 
J f(x)dx = 


= lim { 5) Max (ank — an, k-1) + Š Paxlbax— bnt—:)} 9 
nm kml 
since the points (41) define a normal sequence of partitions 
of the segment ab. Hence the first of the formulae (40) 
follows. The proof of the second one is analogous. 

It follows from the formulae (40) that if the function f 
is integrable in the intervals ac and cb (where a < e < b), 
then it is also integrable in the interval ab and the for- 
mula 5 of § 10.2 (on the división of the interval of in- 
tegration) holds. 

Conversely, if a function f(x) is integrable in the 
interval ab, then it is also integrable in both intervals ac 
and cb (and so in each interval contained in ab, too). 

Indeed, we have by the assumption 


b b b 
J ta)de = f f(w)de = f f(a)de. 


Comparing this pair of equations with the formulae (40) 
we obtain 


e c b b 
( J #(a)ae— f f(w)ax) + (f iiajde— f ias) =0. 
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Hence we conclude by the obvious inequalities 


c € b b 
fide < f flwydx, f flæjde < f tw)ae 


that 
c c ò b 
f fla)dx = f {(@jdæ and ff f(w)de = f f(w)ae. 


Just as for continuous functions we assume the for- 
mulae (2) and (3) for arbitrary integrable functions and 
we prove theorems 1, 2, 6, 7 and 8 of § 10.2. In place 
of the mean-value theorem we have for arbitrary integrable 
functions the double inequality 


b 
(42) m(b—a) < f f(a)dx < M(b—a), 


where a < b and where M and m denote the upper bound 
and the lower bound of the function f in the interval ab 
respectively. 


Theorem 10 of § 10.2 on the differentiability of the 


z 
function g(x) = f f(æ)dx does not hold for arbitrary in- 


tegrable functions. However, it may be proved that the 
function g(x) is continuous. 


Indeed, denoting by M the upper bound of the func- 
tion |f(x)| in the interval ab we have (by the formulae (40) 
and (42)): 


ath x 
lg@+h)—gi@| =| f roa- fioa] 


uth 
=|f feat] <ia, 


whence limg(%+h) = g(a). 
h=o 
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Exercises on § 10 


n]2 


1. Prove that J cos" ada = T sin” vde. 


2. Evaluate the sum I ()- z 4 + 5 4) Beste a ie 


Hint: apply the substitution æ = cost to the integral 
1 
f (1—at)" de. 
0 
3. Deduce the (Cavalieri) formula 


dO en 1 
cone nmr o m+1 


: 

applying the integral f a™dz (cf. also Exercises 2 and 3 
0 

of § 1). 


; 1 1 ; ; 
4. Evaluate um n (ant <. + zl (integrating the 
; 1 
function IF mp 
5. Prove that lim (7 l +— l +.. + =) = log2 
alati n+ an) T 084 


6. Give a geometrical interpretation of the Euler con- 


stant (cf. § 7, Example 18) C = lim (1+ 5+ qt te 
n=% 


—1ogn), applying the equation i = = logn. 


xsin x 
7. Prove that i oo 
terval of mtema uon into halves a substitute in the 
second integral x = x—4t. 

ni2 


8. Prove that d logsinada = —= 5 log2. (First prove that 


dx = —. Decompose the in- 


5 20 a 


n/2 n2 
f logsinada = Tiroit =3/) flo dæ). 
0 0 
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9. Find the length of the are of the parabola given 
by the equation y = 2, lying between the points with 
the abscissae 0 and a. 

10. Given an ellipse with the excentricity e and with 
the large axis of length 2, express its perimeter by means 
of a power series with respect to e. 

11. The circle given by the equation (v—a)?+y? = 7° 
lying on the X Y-plane rotates (in the space) around the 
Y-axis. Evaluate the area of the surface of the solid 
obtained in this way, called the anchor ring (we assume 
a>r). 

12. Evaluate the area of the common part of the 
circle with the radius r and an ellipse with the axes a 
and b having the same centre as the circle. 


13. Applying the Simpson formula to the integral 


1 


f Ilx -m evaluate the 5 first figures of the decimal ex- 
0 


pansion of the number }7z. 

14. Show that the Simpson formula (24) gives the 
M(b—a)4 
576 
the upper bound of |f’’’(x)| in the interval a < æ <b. 
To prove this, introduce an auxiliary function: 


area with an error less than , where M denotes 


c+t 


g(t) = f Hajde- žije- + afl) +4(e+ 0), 
c—t 


where c= 


and deduce the inequality -Elam < g” (t) <How. Get 


the required result, integrating this inequality. 
15. Prove the Schwarz inequality for integrals: 


b b b 
(f Hæ) glæde} < f Piæ)de- OLF 
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b 
(Apply the inequality f [f(£) +¢-g(x)Pdx >0 which 
a 


holds for every c). 


16. Give the formula for the radius of curvature at 
the point x,y for the following curves: 


l lli Z y 
1) hyperbola vy = 1, 2) ellipse atp =], 


3) parabola y = 4p2, 4) hypocycloid 23 +y? =a, 

5) the curve y = æ. 

17. Find on the exponential curve y = e the point at 
which the curvature is a maximum. 

18. Given the hypocycloid from the exercise 16, 4). 
Evaluate its length, the area of the region contained 
inside of it, the volume and the area of the solid of 
revolution obtained by the rotation of this hypocycloid 
around the X-axis. 

19. A system of functions /,,...,fn is called linearly 
independent, if no system of n constants ¢,,..., Cn exists 
except of the system of n zeros) such tkat the equality 


f,(2) +... +6nfr(w) = 0 


holds for every value of zx. 

Prove that a necessary and sufficient condition for 
the linear independence of a system of n continuous 
functions in an interval ab is that the inequality 


Ani» - Ann 


b 
holds, where apm = J fel2®)fm(2) da. 


(Apply the conditions for the existence of non-trivial 
solutions of a system of n equations 


Ay E+ e+ Onin =O (k=1,2,..., n) 


with » unknowns). 
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20. A finite or infinite system of functions fi, f., ... 
is called orthogonal in the interval ab, if the conditions 


for kszm, 


b í =9 


are satisfied. 


Give examples of orthogonal systems among the tri- 
gonometric functions. 


21. Prove that the polynomials (so called Legendre (+) 
polynomials) defined by the formula 


1 de-l 
HUES n! de” 
constitute an orthogonal system in the interval —1, +i. 


+1 
(First prove that if m < n, then f w,(«)ex™dax = 0.) 
—1 


§ 11. IMPROPER INTEGRALS AND THEIR 
CONNECTION WITH INFINITE SERIES 


11.1. Integrals with an unbounded interval of integration 
Let a continuous function y = f(x) be given in an 
z 


infinite interval « >a. Then the integral f{ f(z)dz exists 
a 


for every x >a. If there exists 


lim F(x), where F(a) =f f(z)dz, 


Tmo 


then this limit is denoted by the symbol f f(x)dx and 


called the improper integral (of the first kind) of the 
function f from a to oo. Assuming the existence of this 


€) Adrien Legendre (1752-1833), a great French mathematician. 
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limit, we have then 


(1) f j(w)da = lim ii OLS 


z= a 


We say in this ease also that the improper integral is 
convergent. 


_ Hf lim f j(z)dz = œ (or —oo), then we write f f(w)da 


z=% a 


= co (or — œ); in this case we say that the integral is 
divergent to +00 or — oo. 
Similarly, we define: 


(2) J i(x)de = lim fifa, 


+00 0 co 
and f f(z)de= f f(a)det f jedz 
We have by the definition: 
Í f(w)de = lim [F(2)—F(a)} = lim F(w)— F(a), 


where F is a primitive function of the function f. 
E. g. 


Hence this integral is convergent. More generally, for 
s> 1 the integral 


co 
dx 1 1} 1 
(3) ie = lal ~ gd 
is convergent. 
But for s = 1 we obtain an integral divergent to oo: 


(4) fE =toget? = æ. 
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An example of an integral having neither a finite nor 


an infinite limit is T sinxdz, since lim cosx does not exist. 


t=O 
In the last ATEN the essential fact is that the 
function under the sign of the integral assumes positive 
as well as negative values. In fact, the following theorem 
holds: 


1. If f(z) > 0 for x >a, then the integral f f(x)dx has 


either a finite or an infinite value ( notorii to whether 
£ 
the function F(x) = 3 f(z)dz is bounded or unbounded 


in the region x >a). 


Indeed, the function F(x) being non-decreasing, it 
possesses the limit lim F(a) finite or infinite according 


g= 
to whether this function is bounded or unbounded (cf. 
§ 4.7, 1). 
Theorem +’ of § 4.7 implies the following theorem, 
immediately: 


2. A necessary and sufficient condition for the convergence 
of the integral f f(x)dx (to a finite limit) is, that to any 
a 


c >0 a number r exists such that the conditions x >r and 
x' >r imply the inequality 


z 


| J 1(e)ae| <e. 


x 


Indeed, the existence of the limit lim F(z) is equivalent 


zt=00 
to the condition that to every « > 0 there exists a number r 
such that |F(x)—F(2’)|< e, whenever z >r and a’ >r. 
Since 


F(a)— F(x’) = f flea, sO | fied <E 
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Geometrically we interprete the integral f f(x)dx simi- 
a 


larly as the integral in finite limits: if f(x) > 0, then this 
integral means the area of the unbounded region made 
up of by points z,y such that x >a and 0 < y < f(x). 


11.2. Integrals of functions not defined at one point 


Let a continuous function f be given in an interval 
a<a<b (the interval without the point b). Thus for 
any x satisfying the above condition the definite integral 


T 
J f(z)dz exists. If there exists the limit lim F(x), where 


r=b—0 


F(a) = f f(z)dz, then this limit is denoted-by the symbol 
a 

R f 

Í f(x)dx, as in the case considered in the previous section, 


namely, as in the case when the function f is defined 

and continuous in the whole interval a < x < b (together 

with the ends). In the last case the definition given in 

§ 10 (formula (1)) is consistent with the definition of the 
b 


symbol f f(x)dx given at present. In other words, if 
a 
a function f(x) is continuous in the interval a <s <b, 
b 
then the integral f f(x)dx (in the sense of the definition 


in § 10, formula (1)) satisfies the condition 
b z 

(5) filejas = lim F(a), where F(x) = f f(2)dz. 
a z=b-0 a 


This equation means that F(b) = lim F(x), i.e. that 
z=b—0 

the function F(x) is (left-side) continuous at the point b; 

but this follows from Theorem 10 of § 10 (Remark (ß)). 


The integral of a function f defined in an interval 
a<a<b is called an improper integral (of the second 
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kind). If this integral exists, i.e. if lim F(s) exists, then 


g=b—0 
we say that the integral is convergent. 
If the function f is defined and continuous in an 


b 
interval a < æ <b, then the integral Í f(x)dx is defined 
a 


analogously: 
b b 
OL = lim f t(e)ae : 
a z=a+0 3 


More generally, if a function f is defined and con- 
tinuous in an open interval a < x < b and if the improper 


e b 

integrals f{f(x)dx and ff(x)dw are convergent, c being 
a e 

an arbitrary point of the interval a< x< b, then by 


b 
the integral f f(x)dx we understand 


b c b 
(6) fiiejde = f f(a)da+ f f(a)de. 


It is easily seen that this sum does not depend on 
the choice of the point c. 

Yet more generally, if the function f is defined and 
continuous in an interval a <x <b except of a finite 
number of points (in which the function is not defined 
or is discontinuous), then by the (improper) integral of 
the function f in this interval we understand the sum 


b a az an 
(1) filæjde= f f(w)da+ f f(w)do+..+ f fade, 
a ao ay 


an-ı 


where a = a < a, < a < ... < An = b, and all points such 
that f is undefined or discontinuous at these points are 
contained in the system of the points do, a,, Az, ..., An. 


b 
So the integral f f(x)dx is convergent, if all integrals 
a 


on the right side of formula (7) are convergent. 
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1. If a function f(x) is bounded and if it is defined and 
continuous except of a finite number of points of the interval 


b 
ab, then the integral f f(x)dx is convergent. 
a 


According to the formulae (6) and (7) it is sufficient 
to prove this theorem in the special case when the fune- 
tion f is defined and continuous for a < g< b. 

For this purpose let us note that there exists a necessary 
and sufficient condition of the convergence of improper 
integrals of the second kind analogous to the condition 
given for improper integrals of the first kind (§ 11.1, 2): 


2. A necessary and sufficient condition for the con- 
b 

vergence of the integral f f(x)dx of a function defined and 
a 


continuous in a<x2x<b is, that to any e>0 a number 
ô> 0 exists such that the conditions 0 <b—sæ< ô and 
0 <b—x' <ô imply the inequality 


(8) | [roa] <e. 


Indeed, writing F(s) = f f(z)dz we conclude from 
a 
Theorem 4 of § 4.7 that the existence of the limit lim F(z) 
az=b—0 
is equivalent to the inequality |F (x)—F (x)| < e (when x 
and wx’ satisfy the above mentioned conditions). But 


F(«)—F(2’) = J f(2)de, 


whence the formula (8) follows. 

Let us now proceed to the proof of Theorem 1. Given 
an £> 0, a number ô> 0 has to be chosen so that the 
conditions 0 < b—zx < ô and 0 < b—«2’ < å imply the in- 
equality (8). 

The function f(x) is by assumption bounded in 
a <gx< b. Thus, a number M exists such that M > |f{(x)! 
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for every x in the considered interval. Let us write ô = e/M. 
Now, 


| rea! < |x- r'| M 


and the inequalities 0 < b— x < ôand 0 < b—zr’ < 6 imply 
\ja—a’| < 6 = e/M, whence the required formula (8) follows. 
In this way Theorem 1 is proved. Thus, the notion 
of an improper integral makes possible a generalization 
of the notion of the definite integral to bounded functions 
having a finite number of ae of ees 
pde 


EXAMPLES. (a 
(«) Sa = 


1 f 
(eae, 
o 6 


1 
(8) f sin < de exists by Theorem 1, since the function 
0 


under the sign of the integral is continuous and bounded 
for 0<zxz<l1. 


1. 
(y) Similarly, the integral f Miar exists. In this case 
0 


the integral is considered to be seemingly improper; 
although the function under the sign of the integral is 
not defined at the point 0, it possesses a limit at this 
point. Assuming this limit to be the value of the integrated 
function at the point 0 we obtain a definite integral 
(of a continuous function) in the usual sense. 

(è) Analysing the definition of the (improper) integral 
of a function f defined and continuous in an open 
interval a<a2<b we see that this integral may be 
defined as the difference F(b)— F(a), where F(x) is an 
arbitrary function continuous in the as: interval a < x 
<b and satisfying the condition F’(z) = f(x) in the open 
interval a <a < b (of Rupes if such a ae F exists). 


E. g. the integral j which expresses the length 
[ 


of a semicircle with a radius r is an improper integral 
(the denominator of the integrated function vanishes at 
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the ends of the interval of integration). However, since 
the primitive function of the integrated function, i.e. F(z) 
= —rarcecos(z/r) is continuous in the whole interval 
—r<a2<r, the value of the considered integral is 
expressed by the difference F(r)—F(—r) = rr (just as in 
the example considered in § 10.5). 

Remark. An improper integral of a function bounded 
and continuous except of a finite number of points is equal 
to the Riemann integral of this function. According to the 
theorem on the division of the interval of integration, 
the proof is reduced to the case when f is continuous in 
the interval a < æ < b. Moreover, according to the con- 
tinuity of the Riemann integral treated as a function of 
the upper limit of integration (cf. § 10.11) and to the 
integrability of the function f in the sense of Riemann, 


the Riemann integral of the function f in the interval ab 
z 


is equal to lim f f(a)de, ie. = J f(x)da (the symbols J 
ægæ=b—0 a 
b 


and f are applied here in the sense of the definition 
a 
of § 10.1 and § 11.2). 


11.3. Calculation formulae 


Let the functions f(s) and g(x) be continuous and 
defined for a <z < b, where b may also denote oo. Let 
us assume that the integrals (improper of the first or of 


the second kind) Í f(x)dx and f g(x)dx are convergent. 
Then the formulae 1 and 2 of $ 10. 2 remain valid, for 


i [f(«) +-9(@)]de = lim i [f (2) +9(x)]dx 
= lim f f(s)äz +lim f g(x)ae 


b b 
= f fla)dat f g(a)de. 
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It is proved similarly that the formula 2 of § 10.2 
holds. 

The formula for the integration by parts (i.e. the 
formula 3) remains also true assuming that f{(b)g(b) de- 
notes lim f(x) g(@). 


Similarly, denoting limf(x) by f(b) (where b as well 
z=b 


as f(b) may be also = oo) the formula 4 for integration 


by substitution holds. Namely, assuming the integral 
Hb) 

Í g(y)dy to be convergent, we have 

Ja) 


b z 
J off @))y(a)dx = lim f gff(@)]7'(@)ae 


F(x) Jb) 
= lim J say = im | j g(y)dy = J g(y)dy , 


since the integral treated as a function of the upper limit 
of integration is continuous (§ 10.2, 10). 
Assuming the strict monotony of the function f, the 


b 
convergence of the integral f (g(f(#)] f'(w)dx implies the 
a 


1) 
convergence of the integral f g(y)dy. Hence the pre- 
Ka) 


viously proved relation may be reversed; namely, ac- 
cording to the equation lim h(y) = b, where h(y) denotes 


the function inverse to Yin), the previous TENNEY may 
be performed also in the reverse direction. 

Other calculation formulae: the formula 5 on er 
division of the interval of integration and the formulae 
6-8 may be also generalized easily to the case of improper 
integrals. 

Remark. Let a function f be piecewise continuous in 
an interval ab. This means (cf. § 5.1) that there exists 
a system of points ao < a,< a, <...< an, where a, = a 
and a, = b, such that the function f, defined by the con- 
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ditions f(x) = f(x) for aya < X< ay, fx(Qy—1) = f(k- +9) 
and f,(a,) = f(a,—9) is continuous in the whole interval 
Oy << US ay, (k = 1, 2,..., ñ). 

Then we have 


n 


i jade = X f f(z) = X f feleo)der 


Ket Ap-y k=1 Oy 4 


Using this equation and taking into account the fact 
ay 
that J f,(~)dx is a proper integral we state easily that 


ak 
the formula for the integral of a sum remains valid if 
the functions f and g are piecewise continuous and that 
the formula for the integration by substitution remains 
also true assuming the functions g[f(x)] and f'(x) to be 
piecewise continuous. 


11.4. Examples 


(x) To evaluate the integral J tee , we substitute 


x = tant. Since tan0 = 0 and am tant = co, we have 


i=r/2—0 
o n/2 nf2 
| i n n= f costes SEART at = f cos?"—2¢ dt 
0 (1+) 0 t ò 
_ 1-3 (2n—3) x : 
= a4 (Qn—2) 2 for mn>1 (ef. § 10.1, (e)). 


The same integral may be evaluated applying the 
recurrence formula (§ 9.3, 5, (8)): 


æ i 2 m3 de 
G+ 2n—2 (14 2n—2) (140°) 


and taking into account that 


era i o es i+ 
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(8) To prove the convergence of the integral jae ang 


we shall apply the second mean-value theorem (§ 10. T) 
taking into account the fact that the function is de- 


creasing. We obtain 
é b 
[aed sinedo +5 f sinede. 


Let an £ > 0 be given. An r has to be defined so that 
the conditions b > a >r imply (cf. § 11.1, 2): 


[tele 


Now, 
v 

f sinsäs <2 and so f TT a| < 2(ž+3) oa 
u a 

Thus, it suffices to assume r = =, 

We note that 
(9) TE. Sinne y sf Sn? ae (a> 0). 

n=O 


Namely, let us substitute y = nz. We obtain 


a na 
‘sinne, f siny 
(10) Í a de = | Y ay 
0 0 
and 
na co 
lim EDY ay =Í D dy, 


because lim na = oo. 
Nm 00 
; : sing 
Remark. Let us write In = f -y da. Then we have 
nr 
sing 
f — de = 5 In. This is an alternating series (which is 


n=O 
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also easily to illustrate geometrically on the graph of 
the function y= mg, cf. Fig. 25) with (absolutely) 


decreasing terms tending to 0. Indeed, substituting 
y = 2—nn we have 


sin sin(y +7) nn) g siny 3 
In - f ut dy =+ pa 


y+nT Y +NnNT dy 
and 
siny Í siny 
d —— m dy = F Ini. 
{= g y+(n—1)n Fini 


Fie. 25 


Hence it follows easily that for every a > 0, we have 
the formula 


(11) f ECHEZ 
This formula p with formula (10) gives 


(12) EZ aol < f Sac. 


(y) Similarly as in the previous example, we prove 

the convergence of the integral f sin(a*)dx (the Fresnel 
0 

integral applied in optics) although we do not know the 
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indefinite integral. Substituting <? = t we obtain 


o0 


f innisg f Sita 


1 


Applying the second mean-value theorem to the last 
integral we find that 


g b 
sint 4 1 if : 1 ; 
ie — | sintdt ++ f sintat 
“Vay yo: 
© sint 


and we prove the convergence of the integral f FAA 
by the same arguments as in the previous example. Thus, 


the integral f sin(z?)dx is convergent, too, and so does 
1 


o 1 
the integral f sin(a#*)dx, since the integral f sin(a*)da is 
0 0 
a proper one. 
(3) We have proved previously the convergence of the 


integral i T ao, Now, we shall prove that 


sing tid 
(13) f| ar =F. 
According to (9), 


f Stai Í an ae, 


n=00 
0 


whence 


oo 


f| a tim f ‘sin(2n-+1)ar 9 
0 


nmo z 


We shall reduce the last integral to the integral 
sin (2n +1)x 
0 sing 


ni2 
dx, which we evaluate now. Namely, we 
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shall show that 
ni2 
f sin (2n +1)x 


- dx = 
sing 


(14) 


bola 


Indeed, it follows from the formula (cf. § 1, (2)) 


. 2n+1 
1 sin 3 t 
g t Cost + COB2t +... + cosnt = r 
2sin- 
2 
that 
sete = 1+ 2cos2r + 2cos4r+...+2cos2nz, 
whence 
x2 , 
f sin (2n +1)z 5 
: sing 
0 
n2 nj2 
7 vi 
=5+2[ cosrde+...+2 | cos2nzda = z ; 
0 0 


since all integrals appearing in expression in the middle 
part of this formula vanish. 

Hence the formula (14) is proved. It remains to prove 
that 


im f sin(2n+1)a_ sin(2n +1)2] zy 
nmoo sinz x ~ 


i. e. that 


n/2 


lim f ZAD sin (2n +1)edz =0. 


Now, the last equation is a direct consequence of the 
formula 
ni2 
lim f f(a) sinnadx a 0 


N=OO g 
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which we have proved already (§ 10.2, (y)), after the 
substitution 


ftp) x— sng 


æsing 
The function f defined in this way is continuous, since 


g— sing 
m na m EES S 


for 2>0 and f(0)=0. 


sin næ 


(e) Dirichlet integral: f f(a) dx. 
0 


We shall prove that if the function f is monotone and 
if f' is continuous in the interval 0 <x <a (a> 0), then 


(13) lim fie ja) 2 ™ ae = F0). 


Let a number <> 0 be given. We choose c in such 
a way that 


(16) If(ce)—f(O)|<e and O<c<a. 
In order to estimate the difference Si f(x) onn dx — 
-31 (0) , let us write 
f sin nx IN nx 
J iy ae- F4(0) = i 0 de 
0 


Se Tie- 5) + +f fla) SINNT 9 


and let us estimate each of the three terms on the right 
side separately. 

To the first term we may apply the second mean- 
value theorem, since the function g(x) = f(%)—f(0) is 
monotone. Taking into account that g(0) = 0 we obtain 


1 Ha- f(0)] E ax = pe-o f ae, 
 O<k 


ii 
o 
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By (12), 
e a rr 7 
| f sinne del <2 sing 
F x 


d ~“ 


< 


This inequality together with the inequality (16) gives 


m 
sinne y sing 
< Be [ae 
P £ 


(17) [fro KO) 


To estimate the second term let us note that by (9) 
and (13), 


Hence we have 


ce 
sin nx T 
f dz— = 
£ 2 


0 
for sufficiently large n. 


Finally, replacing f(x) in the formula § 10.2, (y) by 
an ) 


(18) <E 


and taking into account the inequality 0 < c < a, 


Ess obtain 
a 

lim | f(x) eee dz = 0, 

ROL 
whence we conclude that 

a 
(19) | f 1m Ear <a 
c 


holds for sufficiently large n. 


The estimations (17)-(19) give the required estima- 
tion for 


f 1) 2 ae Fro), 


whence we obtain formula (15). 
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Remark. The formula (15) remains valid, if we re- 
place the assumption of continuity of f and that of 
monotony of f by a weaker assumption, namely, by the 
assumption that the function f is piecewise continuous 
together with its derivative and piecewise monotone; here 
{(0) has to be replaced by f( +0) (in the case when the 
function f is discontinuous at the point 0), i.e. 


sinne y 


(20) m Ho de = 5 j(+0). 

Indeed, our assumption means (cf. § 5.1) that there 
exists a system of points 0 = ao < A, < la < ... < Am =a 
such that the function fy defined by the conditions 

fela) = f(x) for Ak- C< ap 

and fx(@x-1) = f(a- +0), fax) = f(ax—9) 
is continuous together with its derivative and monotone 
in the whole interval a,_, <#@< ax, for each k <m. 

Applying the theorem on the division of the interval 
to the improper integrals we obtain 

a . ay . am . 
sin ne sinna sinnx 
T f(x) Fs ds = f f(x) z de... + Í fla) ; dz. 
ao am-t 


0 


Hence 


sinne y sin nx 
im f x = lim x -z 
lim | f(a) o Sim [te 


k=l Ope, 


But this gives the formula (20), since by (15) we have 


sin NE g 


5 h(0) = 51(+9), 


sin ne 
dx =0 
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for each k> 1, the function i) being continuous in 


the interval az; < £ < ük. 
(č) The following formula which will be used in the 
theory of Fourier series follows easily from the formula (15): 


a 


: ` sinng 
(2) Jim jies 


de = 5f(+0), 0<a<r; 


here we assume as previously the function f to be piecewise 
continuous (together with its derivative) and piecewise 
monotone. 

For this purpose it is enough to note that if we have 
O<Ku<v< r, then 


. pr sinne a d sinne) 
lim} | jlx) aig dx Jio z dæi 


n=O 
u 


v 
== lim Ha) a enh 


n=O Esme 
u 


For, taking into account the equation lim EMT _ 0 
ceo USING 


(cf. § 8.4, (18)) and the inequality z < x, we may substi- 

tute to the function f(x) in the formula § 10.2, (y), the 

" ; e— sing 

function f{(«) ———. 
gsing 


l ) re Vr 
(n) Poisson (?) integral f e-®dr = = 
0 
First of all let us note that applying the substitution 
v= z yn, we obtain 
(22) f ede = Vn f etde. 
0 


(i) 


(C) Siméon Poisson, an author of numerous works in the cal- 
culus of probability, in mechanics, physics and astronomy. 
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In order to be able to compare the last integral with 
the integrals 


1 


2.4... 2m 
— r? = 
(23) fo rdx 3.5. (am Hi) 
Fd 1-3- (Qm—3) m 


(1+ 2-4... (2n—2) 2 


which we already know (cf. § 10.2, (5) and Example («)), 
we apply the double inequality 


1 
= -2 < o 
1—# <e SIFA 


which follows from the inequality e > 1+ t (cf. § 8.4, (16)) 
by substitution t = — 4° and t = 2. Then we have 


1 
STFer 


(the first inequality being valid for [x| <1), whence 


fa- x) rae f cota f emas f E Gia 


Taking into account the formulae (22) and (23) we 
conclude that 


2.4. ag, 1:3- (2—3) T 
E aa< de <7: 1 (an aV" 


Denoting by a, the left-side term of this relation 


(1— a)" <e” < 


and by b, the right-side one, we have a, < f e-h da < by 
0 
for each n = 1, 2,... 
Now, we have by the Wallis formula (§ 10.9, (25)): 


Vx 


n=c0 ee Syn Ge. =i 
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Hence an = ae and, since the sequence {c,} is 
decreasing as easily seen, VE <a, i. e. 5 < 20h; hence 
- (2m -- 3) 4 2n 
< aa oT 
in Vn n= 3) 700 = on on I 


Consequently, we conclude that 


fo] 
2n f i 2n 

a < T < e - 

Ch nti S, e a ea | 
and since 

2n 
——_ = 1 
ae 2 +1 1 he 2n—1 i 

we have 


11.5. The Gamma function T(x) = f tied, > 0 
0 


This integral possesses for æ< 1 both singularities: 
namely, it is an integral in an infinite interval of in- 
tegration and moreover, the integrated function tends 
to co as ¢ tends to 0. In order to prove its convergence 
we shall decompose it into two integrals: 


1 co 
(24) feed and fte-te-tat 
0 1 


and we shall prove the convergence of each of these 
integrals separately. 

To prove the convergence of the first of these integrals 
Jet us note that 0 < #—1e-' < #~!, since t > 0. But the inte- 


1 
gral f t7-1dt is convergent, since 1—x < 1 (cf. $11.2, («)); 
0 
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hence we deduce the convergence of the first of the 
integrals (24). 
Now, 


pieta l and dat =O ek BT for 
(4 aR an ae (cf. § 7 (27)), 


whence we have i#-!e-!'< 5 for sufficiently large‘t, and the 
convergence of the second of the integrals (24) follows 


from the convergence of the integral Í 5 (ef. (3)). 


In this way the convergence of the integral I(x) is 
proved for every x> 0. 
Now, we shall prove for positive integers n the formula 


(15) T(n) = (n—1)! 


For this purpose we apply the formula for integration 
by parts to the integral T(x) for «> 1: 


~ ~t 
(26) Ie) =— i je-1 at 


= — [irte] + (1—1) f -e-tdt = (x —1)r(x—1). 
0 


Hence we deduce the formula (25) by induction, ap- 
plying the equality ` 


[=e] 
DO) = fetdt =1=0! 
0 


Let us note that the Poisson integral considered in 
§ 11.4 is one half of the value of the T function for x = }, 
since substituting t = 2* we find 


(27) rài) = [fama f eraya. 
i 0 0 
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11.6. The relation between the convergence of an integral 
and the convergence of an infinite series 


THE CAUCHY-MACLAURIN THEOREM. Let the function 
f(w), «>a, be continuous, decreasing and positive. Then 
a necessary and sufficient condition. for the convergence of 


oO 
the integral JS f(x) da is the convergence of the infinite series 
a 


2 atm). 


Fic. 26 


By the assumption, f(a+ n) <f(x) <f(a+n—1) for 
a+n—l<a2<a+n. Hence 


a+ n at+n atn 
f ila+njde< f fde< f f(atn—1)de, 
a+n-1 a+n—1 at+n—1 
i.e. 
at+n 
f(atn)< f f(a)de <f(a+n—1). 
a+n-l 


Denoting by Sn the partial sum of the series 3, f(a +m), 
m= 
i.e. Sn = f(@+1)+...+f(a+n), we have 


atn 


Sa < J fw)de < Sa-i + f(a). 
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Assuming the integral to be convergent, we conclude 


that the considered series is bounded: S, < f f(x)dx, and 


a 
so it is convergent (as a series with positive terms). Con- 
versely, assuming the convergence of the series, we have 


a+n oo 
f f(x) dæ < J f(a+m) for each n. 


Hence 


f ilæ)de < J fla+m) for every z, 


m=0 


since, denoting for a given v by n a positive integer 
such that s <a-+n, we have 


a+n 


J Hade < f iade < X fla+m). 


m=O 
z 
So the function f f(x)dx is bounded and, consequently 
a 
the integral f f(x)dx is convergent (cf. § 11.1, 1). 
a 


Remarks. («) The assumption that the function f 
is positive may be omitted in the above theorem. Namely, 
if a decreasing function is negative, then the integral as 
well as the considered series are divergent to — oo. 


(B) If the integral f f(x)dx of a decreasing function 
a 
is convergent, then lim f(x) = 0, as is easily seen. However, 
Tmo 


if the function is not decreasing, then the integral may 
be convergent although: this inequality does not hold. 


The evidence gives here the integral f sin(a*)dx which 


0 
we have considered already in § 11.4, (y); this integral 
is convergent but the limit of sin(x?) as œ tends to oo 
does not exist. 
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Assuming f(x) > 0, an even stronger singularity may 
be obtained. Namely, let us construct an infinite sequence 
of isosceles triangles with height 1 and having the inter- 
vals (0,1), (,114),..., (n, n +g) .. Of the X-axis as 
bases, successively. Let y = f(x) be the graph of an 
infinite polygonal line constituted by the sides of these 


Fic. 27 


triangles (different from the bases) and the segments of 
the X-axis joining the successive triangles. Thus, the 
region contained between this polygonal line and the 
X-axis is constituted by the above triangles; hence its 
area is the sum of their areas, i.e. 


11 
REOLER EITENS +... =1. 
; 2 4 


gnti s. 


However, lim f(#) does not exist. 
Lm 


oo 


EXAMPLES. (x) The series ¢(s) = » 1 is convergent 


nml 
for every s > 1 (4), since the integral f a is convergent 
1 
(ef. § 11.1, (3)). 


(B) The series X n(logny" is convergent for s>1 and 
nnd 


divergent for s =1. 


(C) The (Riemann) function f(s) is of great importance in the 
theory of numbers. 
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o% dx 
To prove this, let us consider the integral J aloga 
Now, 
f dx = Hoer 1 a for s>1. 
2 (log) (logs)? 1-8 (logz) 
Since 
lim (logs)! = co, 
t=% 
we have 


(ee oe 
je (log)* (s—1)(log2)*? 
Hence we conclude by the Cauchy-Maclaurin theorem 


that our series is convergent for s > 1. Yet for s = 1 this 
series is divergent, for 


f dx _ f dlogx 
vlogs J logs 


= log(loga) . 
According to the equation lim log(logz) = oo, this implies 
Ta 


l f T dr 
h : i . 
the divergence of the integral J zlogz 


(Y) Similarly, it may be proved that the integral 


EE eee 
J x (log x) [log (log «)]’ 


is convergent for s > 1 and divergent for s = 1 (where a 
is sufficiently large). Hence the series 


oo 


1 


n=k 


is convergent for s > 1 and divergent for s = 1. 
More general results may be obtained considering the 
product of n successive iterations of the logarithm the 
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last of which is raised to the power s (in the previous 
example n = 2, the zero-iteration = 2). 
This leads to further types of convergent series and 
to an infinite sequence of infinite series 
oo oO 


yi, A a A ase 
=- ete. 
nlogn’ 1 niognlog(logn) 


n=1 


divergent more and more slowly. 
(3) Logarithmic criteria. The comparison of the 


co 
terms of a given series > a, With the terms of the series 


n=2 
co 


z leads to the following convergence criterion: 


naz n(logn) 
tf dn >0 and if 
. log(na,) 
oe) an log (log n) Srt 


[e] 
then the series Dan is convergent; if this limit is >—1, 
n=? 


then the series is divergent. 


Indeed, let us assume the inequality (28) to be satis- 
fied and let us denote by —s a number greater than 
the considered limit and less than —1. Then we have 
s>1 and 


log (na,) < —slog(logn) = log (logn) 
for sufficiently large n, whence 


1 


< (logn) i.e. <—. 
naar O08 Í n(logn)* 


Thus, by the theorem on the comparison of series 
with positive terms, the convergence of the series 


00 1 . 
2 aliogay implies the convergence of the series X an. 


Yet if the limit considered in the formula (28) is 
greater than —1, then for sufficiently large n we have 
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log(na,) > —log(logn), whence na, > (logn)~’, i.e. an > 


fo e] 
>—— and the divergence of the series X) ——— 
nlogn naz Nlogn 


implies the divergence of the series > apy. 


nm 

The case when the considered limit is equal to —1 
is for our logarithmic criterion a ‘doubtful’ case, i.e. we 
are not able to state by this criterion whether the series 
is convergent or divergent. However, in this case stronger 
logarithmic criteria of the considered in Example (y), 
may be applied. 

Let us add that there exist series (with positive terms) 
which do not react to any logarithmic criterion. 


11.7. Fourier (:) series 


Suppose that we are given a convergent trigonometric 
series of the form 


(29) f(x) = }a,+ (a cosg + b sin x) + (a,cos 2a + basin 2x”) + 
+... + (an COSNE + b,sinnx) +... 


We note that if the given series is uniformly convergent 
in the interval — r < v < z, then the coefficients a, and bẹ, 
may be expressed easily by means of the sum of the series, 
i.e. of the function f. For, according to the uniform con- 
vergence we have (cf. § 10.2, 12) 


kid kid ben] Tv 
f He)ae = IELTS f (a,cosnar + bq sinna) de 
TR -n n=l -r 
and since 
n rT 7 
f cosngde = 0 = f sinngdæ and { ax = Thy; 


~~ -r 


€) Jean Fourier (1768-1830). Fourier introduced the expansions 
of functions known under his name in connection with his work in 
the theory of the heat conduction. 
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we have 
1 r 
(30) a, == { S(a)dz. 


To evaluate a,, we multiply both sides of the identity 
(29) by cosna and we find 


J Hepomiade = conn 


-r 


3 E EEE E daeaniide, 


mm=l -r 


just as in the previous calculation. 
Since (cf. § 10.1, (ò)) 


f cos nxrdx = n 


-r 


m 
and f cosmzcosneds = 0 = f sin macosnadr 


-r -r 


for m Æ n, we have 


le 
(31) On = = SJ tajeosnads 
Similarly we find 
(32) ey f(a) sinnada . 
bn =- J sinn 


The following question arises: which functions f 
may be represented in the form (29), the coefficients a, 
and b, satisfying the formulae (30)-(32) (the so-called 
Euler-Fourier formulae). If such an expansion exists, then 
it is called the Fourier series of the function f. 

Since the functions cos and sin are periodic, it is 
evident that the periodicity of the function f has to be 
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assumed, too. Moreover, we shall assume that the func- 
tion f is piecewise monotone (cf. § 4, 2). 

We shall prove the following 

THEOREM. Every periodic function f with the period 2x 
(i.e. f(xw+2n) = f(x)), piecewise continuous (together with 
its derivative), piecewise monotone and satisfying (at the 
points of discontinuity) the condition 


may be expanded in a Fourier series. 
Let us denote by S (x) the n-th partial sum of the 
series (29), i.e. 
(34) Sn(x) = $a,+ (a cose +b sing) +... + 
+ (a,cosnx +b sinna) . 


We have to prove that if the coefficients satisfy the 
conditions (30)-(32), then 


(35) f(x) = lim S,(z). 


The above mentioned conditions make it possible for 
us to transform formula (34) as follows: 


(36) 7S,(xv) = faroa f KD lcostcose+sintsins)at + 


+.. + | f(t)(cosntcosnz + sinntsinng)dt 


== f f(t)(4+cos(t—a)+...+ cosn(t—x)]at 


T sin (2n +1) = 
= Í O R T dt 
-r 2sin 32 
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by the known formula (ct. § 1, (2)) 


an+1 , 


sin 
2 


$+ cost + cos2t+...+cosnt = r 
2sin 5 


Let us substitute = = 2. We obtain 


(37) nala) = f f(a +22) Sinn oN a. 


-rt 
5 


Decomposing this integral into two integrals in the 


intervals from 0 to = and from = to 0 and 
substituting in the second integral z = — y, we obtain 
z-z 
(38) nSala) = f pata PEND ag 
F sinz 


zig 
+f e= yon thes dy . 


siny 


Now, we shall prove the equation (35) for —n < g < n. 
According to (33) it is sufficient to prove that 


; sin (2n +1)2 4 
69 im f jetz r ae = 5 ieo) 


and 
zz 


(40) im f fe- 2y) SEI ay —  i(a—0). 


Given 2, let us write f (x+ 2z) = g(z). Then the function 
g(z) is piecewise continuous (together with its derivative) 
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and piecewise monotone. Hence it satisfies (cf. (21)) the 
formula 


(41) im f 9% = dz = 5 9(+0), if O<a<n. 


In this formula a may be replaced by = , because 
the inequality — x < æ < x implies the inequality 0 < a 


<n. Since g(+0)=f(x+0), formula (41) gives (39) 
immediately (we restrict ourselves from the sequence 
m=1,2,... to the subsequence of the odd numbers). 
Formula (40) is obtained in an exactly similar way, 
writing f(w~—2y) = h(y) and taking into account that 


0< nat mx and that h(+0) = f(x— 0). 
Thus, our theorem is provea for —n <gæ< m. It re- 
mains to consider the case when æ = — x (or when v = t). 


Let x =—rn. According to (37) we have 


=: : sin (2n +1)z 

— 7) =f ont 22) a: z 
Decomposing this integral into two integrals in the 
intervals from 0 to $x and from 4x to v and substituting 

y =x—z in the second integral we obtain 

nf2 
= sin(2n +1)z 
np (— r) = f fj(—r Pere o 


sin (2n +1)y 
+ Jra- 2y) ae dy . 


dz + 


The first of these integrals tends to $xf{—x+0) as 
previously and the second one tends to }xf(x—0), i.e. to 
$xf(—x—0) (since the function f is periodic). 

Hence the formula (35) holds also for æ = — n; hence, 
according to the periodicity, it holds for every zx. 

In this way our theorem is proved completely. 
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11.8. Applications and examples 


(a) Let f(x) denote a periodic function with the period 
2x given by the following conditions: 


fjlæ)=— 4r for -—-n<a2<0, f(0)=0, 
f(z) = x for 0O<a<n, f(tr)=9. 


The graph of this function consists of segments of 
the length x lying on the straight lines y = r and 
y = —}n, alternately, and of points on the X-axis being 
integer multiples of the number v (the ends of the segments 
do not belong to the graph). 


-2n -7 (6) ka 2n 
Fig. 28 


It is immediately seen that the function defined in 
this way is piecewise continuous and piecewise monotone 
(namely, it is monotone in intervals of the form (m—1)r < 
<g&<mr, where m is an integer); moreover, the con- 
dition (33) is satisfied. The theorem on the expansion 
in Fourier series may therefore be applied to this function. 

We calculate the coefficients a, and b, according to 
formulae (30)-(32). 

We obtain 


0 we 
a, = 5 | —cos nada + f cosnodo} =0 (n>0), 
0 


0 r 
_i inn: f ; ltiz 
b= G{ J sinned sin nada = a, 2 2cosnr) , 
-r 


and so b, = 0 for n even and b, = 1/n for n odd. 


11. IMPROPER INTEGRALS 305 


Consequently, 
sing sings sinr 
(42) Malaga a 
So, for x satisfying the condition 0 < z < x, f(x) may 
be replaced by jx. 
In particular, substituting x = rn we obtain the 
Leibniz expansion 
W 
4 
which we already derived (cf. § 7, (51)). 
(B) Let f(x) be the function with the period 2x defined 
as follows: 


}(x)=427, when —r<a<n, f(—xr) = 0 = f(x). 


E a | 
=l pr gas 


We see easily that the function f defined in this way is 
piecewise continuous and piecewise monotone (cf. Fig. 29). 


Fic. 29 


Moreover, the condition (33) is satisfied. Thus, the func- 
tion f may be expanded in a Fourier series. 
Calculating the coefficients a, and b, according to the 
formulae (30)-(32) we find 
æ sing sin2z_ singz 


a aus a 


wy LELT. 


Let us note that substituting 7 = 4x, we obtain the 
Leibniz expansion for } x (just as in the previous example). 

(y) Let us expand the function f(x) = |æ] in the interval 
-rn <a: x. For other x the function is defined by the 
condition f(x + 2m) = f(x). Hence it is a continuous func- 
tion on the whole X-axis. The graph of this function is 
a polygonal line. 
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We now calculate the coefficients of the expansion 
in the Fourier series: 


ay =~ | izjäz =? f zaz =n, 
“at 0 


n T 

7 2 
2 | |x| cosnadx = — f wcosnada =0 or a 
T a T ; TN 


ag 


An = 


according as n is even (>0) or odd. For, 


1. 1 ; 
zeosnede = r sin ng— m sinngdae 
- a esinne + 5 COSNL. 
mn 
Similarly, we find that b, = 


- f la|sinneds = 0. Thus, 


(44) [al = 


x 4 /cosr cossa  cosdzr 
A ree 


ja 32 52 


Let us note that by substituting z = 0 we obtain 


n 1 1 1 
(45) gT ptg gte 
Hence we obtain the Euler formula 
g2 
(46) Te Gt ataete. 


For, ne by s the sum of this sn we have 
s s 


7a =atE ta oe and so ce ate +5 a 


Le. $s = }2n?, that is s = tr’. 


(5) Let y = costz, —x <x < v and let us assume that ¢ 
is not an integer. The formulae (30)-(32) easily give: 


2, a 
lg = = sin ct , Gn == (- 1) aa zp Sin tt b, = 0. 
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Thus, 


1 cosg | cos2ex 
(47) TCOBIT = 2tsin nt (55 — Pot poe 
In particular, substituting v = z and dividing both 
sides of identity ~ by sinzt we obtain: 


1 1 
(48) neotrt = s+ ata TI + po + ~) . 


The formula (48) has the following interesting ap- 
plication. 
Let us write 


2t 
n=l 
Given a number æ satisfying the condition 0 < æ< ł, 
the series S(t) is uniformly convergent in the interval 


3 = E 1 
<t < 
O0<t<a@, since wp S a and the series Sats — 
is convergent, as is a seen. 
Therefore the series S(t) may be integrated term by 


term in the interval 0 <t <x. Since 


J -2 att = — log (n?—#*), 


z 
` 2t a 
we have Í aap dt = —log (1-5). 


0 


Hence (cf. § 10.2, 12 and § 5, (12)): 


x 2 z œ r 
J S(é)dt = — 2 vehi- 3) = ~ve | | (1-5). 


On the other hand, 


sin =, 


T Í (cotzt— SLE logsin xt — log zt = log— 
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Thus, 
d 1 
T f (cot nt— = )at 
F xi 
= log SIN TL tim log sin xt ah sin re 
nE t=+0 T TE 
since 
lim lo giant = log lim on ogi = 6; 
t=+0 f= +0 


Taking into account the fact that the relation (48) 
holds for every ¢ satisfying the inequality 0 < t < æ% and 


that the function cot xi— 1 has a right-siđe limit at the 


point 0, namely lim out 3) = 0 (cf. § 8, (19)), we con- 


t=+0 
clude that 
z 


: z 
n | (cotmt—Z)ar=— f sar, 
0 


i.e. 
sin rge > a 
oe a =tog | [ (1-5), 
n=1 
therefore 
; : = x 
(49) sinne = ne] | (1-5), —l<@<i1. 


n=l 


Let us note that by substituting in the formula (49) 
æ = 4, we obtain the Wallis formula already derived 
(ef. § 10, (29)): 


oo 


wo) T=- =2.2.4.4.8.6 _ 41636, 
2o 4n?-1 133557 °° 31535 


n=l 


Substituting « = }, we obtain 
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from which we conclude by (50) that 


V3 —222.6:6 10-10 _ 4 36 100 
1-35-7 9-11 "3°35 99 


Exercises on § 11 


fe +] co 
az f arctan s dz. 


1. Evaluate Jaa , F T+ 


2. Investigate the convergence of the integrals 


1 


[oF 1+2 


Cosg ” COST 
dx , | dx . 
0 0 


3. Let lim f(x) = 0 and let a number ¢ > 0 be given. 


Two 
Let us write 


aten 


an= f Hode. 


a+e(n—1) 
If the series a, + @ +... is convergent, then the integral 
f f(x)dx is convergent, too, and is equal to x an. 


n=l 
Apply the above theorem to the proof of the con- 
vergence of the integral 


œo 
sing 
—— de 


0 
4 An integral f f(x)dx is called absolutely convergent, 
. a 


co 
if the integral f \{(x)|da is convergent. Prove that an 
a 


absolutely convergent integral is also convergent in the 
usual sense. 


5. Prove that the series i at > is convergent (k > a). 
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6. Prove that | 


(Expand the function under the sign of the integral 
in an infinite series and apply the formula (45)) 
1 1,1 1I 


7. Prove that Ro gat 3 gt is 
mula (45)). 


8. Expand the functions: 


1 2 
i SA de=” 


z? 
= 55 (cf. the for- 


1) a, 2) wcosx, 3) |sina|, 
4) sinhiz, 5) cosh tæ 
in Fourier series. 
9. Assuming that the system of functions fi, fo, ... 


co 
is orthogonal and that the series f(x) = X anf,(x) is 
Nel 


uniformly convergent (in the considered interval ab), 
calculate the coefficients a, (by means of the functions 


f, fis fas w+) 


SUPPLEMENT * 


ADDITIONAL EXERCISES 


Exercises on § 1 


1.1. Prove that 
jasinag + beosa| < yat b?. 
1.2. Prove that 


la+ a+... + anl < jal KA UA 
berare a aa lel 


1.3. Prove the inequalities 


Va+b<Vya+yò and ya—yo| < Vati. 


for a > 0, b > 0 (where m is a positive integer). 


1.4. Prove that if c > 1, then the inequality 
= eee 
1l+q@ 1+% 

holds for any a and b. Show that the numbers ce <1 do 


not possess this property. 
1.5. Prove that 


for a > —1 (m is a positive integer). 


< cla— b| 


* Written by W. Kolodziej. 
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1.6. Show that for any positive integers n and k the 
following inequality holds: 


Hint: Substitute a suitable integer m in the inequality 
m> 14 m (obtained from the Bernoulli inequality). 

1.7. Find the upper bound and the lower bound of 
the set of all decimal fractions of the form 0.11... 1. 

1.8. Similarly: find the bounds of the set of all numbers 
of the form (n+ m)"/2"", where n and m are positive 
integers. 

1.9. Let Z, and Z, be two non-empty bounded sets 
of real numbers. Denoting by Z,+, the set of all sums z+ y, 
where x belongs to Z, and y belongs to Z,, show that 


sup Zz, = supZ,+supZ,, 
inf Zz y = infZ,+ infZ, , 
(the symbols supZ and infZ mean the upper bound and 
the lower bound, respectively, of the set Z). 
Exercises on § 2 
2.1. Evaluate the limits 
lim(Vn+yn -Ya), lim V/V PBC, 


n= n=00 
lim 10$ 2k... + nk (k an integer), lim (1+ sa) 
2.2. Prove that the sequences 
(cos =") \ a and ((—1)"™"® yn} 
are divergent. 
2.3. Similarly: prove the divergence of the sequences 


{sinnt} and {ceosnt} (O<t<n). 


Hint: Every interval of the length ¢ contains a number x 
of the form a = nt, where n is an integer. 
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2.4. Let {an} be a non-decreasing sequence of positive 
numbers. Prove that 
lim V af + az +... + an = lim an. 
Nm n=00 
2.5. Let a non-empty and bounded-above set Z be 
given. Prove that the number M is the upper bound of 
the set Z if and only if M > x for every x belonging to Z 
and lim £, = M for a sequence {z,} with terms belonging 


w=00 


to Z. 

Express and prove an analogous theorem concerning 
the lower bound. 

2.6. Given a number ¢ > 0 we define the sequence {an} 
by induction as follows: 


c 
G4 >0, an= (a+ £). 
n 
Show that lima, = ye. 


26== 09 
Hint: Prove that the sequence a,, az, ... is decreasing. 
2.7. Prove that every convergent sequence either 
contains a greatest term or contains a least term. 
2.8. A sequence {an} is said to be of bounded variation, 
if the sequence {s,} with terms 


8n = |a; —4,| + |as — aal + ... + On 41 — an] 

is bounded. Prove that every sequence of bounded varia- 
tion is convergent. Show by an example that the con- 
verse theorem is not true. 

2.9. Find the limit of the sequence {a,} defined by 
induction thus: 

1 
B a or 

Hint: Note that |ay4,—an| < (4)"~"|a, —a,|. 

2.10. Let {an} be a sequence bounded neither above nor 
below and such that lim (a,,,—a,) = 0. Prove that every 


n=% 
real number is the limit of a certain subsequence of this 
sequence. 
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Exercises on § 3 
3.1. Prove the convergence of the series 
yaa 1-3-....(2n—1) 1 
te i 


4” 2-4- 2n 2AL’ 


n=l n=l 


= (1y"* 1 . xm 
J M, —-- sin —. 
n+(—1)""" — yn 8 


mt n=l 


co 
i x 1 
3.2. Prove the convergence of the series y = 
i nai ov" 

3.3. Examine the convergence of the series 


1 1 1 1 1 
Sig gh at 5 ao 


3.4. Assuming that ¢ is not an integral multiple of 
oO 


the number 2x, prove that the series > on is absolutely 
n=1 


convergent for a >1 and conditionally convergent for 
0O<a<l. 


CO 

; : f qjcosnt 

Hint: To prove the divergence of the series D a 
nol 


for 0< a < 1, apply the inequality |cosnt| > cos?nt. 
3.5 nue that if a, > 0, then the convergence of the 


series > a, implies the convergence of the series y Gn. 


n= n=1 


3.6. Prove that if the series 2 an and y bn are con- 


n= he 


vergent and an < ĉn < bn, then the series y Cn is con- 


mat 


vergent, too. 
œ 


3.7. Let J a, be a divergent series with positive terms. 
n=l 
Prove that the series 


oO 


= 
@,+4,+...+4n 


n=1 
is also divergent. 
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Hint: Apply the Cauchy theorem (§ 3.2.1). 
3.8. Prove the convergence of the sequence {an} with 
the general term 


dn = 2 yn— Fe + a + 
amas Fa va) 

Hint: Note that every com is the sequence of 
partial sums of a series. 


3.9. Prove that the series yas is convergent. 


n=1 


3.10. Prove that the series Fie iv ae has the 

n=1 n 
following property: for every real number x one may 
group its terms in such a way to obtain a series convergent 
to z. 


Hint: Apply the theorem of Exercise 2.10. 


Exercises on § 4 


4.1. Evaluate the limits 


1— ; 
ae , limelog(x+ 2”), 
£=0 


Vr- 


lim 


£=0 


4.2. Evaluate the limits 


lim(sinfa+i—sinyz), lim DEEE: 
x=% 2-00 log (#+ 3") | 
4.3. Investigate the existence of the limits 


au TI — coss ; i 
VZCO tim (14a) 
lim sing ” T E aaa 
: 1 ; E 
lim an z) , lim e ain Va. 
x£=0 x H L=0O £ 


4.4 Show by an example that the following theorem is 
false: if Bg, A and nn g(y) = B, then lim g[f(zx)] 
= B (ef. § 4.6 (16)). á 
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4.5. Let 


1 
fle)= D aT i 


n=1 


Prove that lim f(x) == +00, lim f(r) = 0. 
£=4+0 L= 00 


Exercises on § 5 
5.1. Evaluate the limits 


/cosa — 
lim esl jim n a 


r=0 x? f x=0 i 
. ař—l : 3 
lim -——— (a>0), lim(cosg) =. 
x=0 X z=0 


5.2. Prove that for every « the following formula 
holds: 


e* = lim l + zy. 

n— oo n 

5.3. Suppose that the function f satisfies for any x 
and y the condition 


fiæ+y) =f(z)+fly). 


Prove that if f is continuous at a point a, then it is 
continuous at every point. 

5.4. Let the function f be continuous in the interval 
a<a«<b and let for every sequence {xn} with rational 
terms belonging to this interval the condition lim 2% = a 


n= 
imply lim f(x) = g. Prove that there exists lim f(x) = g. 
n=00 n=00 


5.5. Assuming that the function f is continuous in 
the interval a < t < b, denote by F(x) the upper bound 
of this function in the interval a < t < x. Prove that the 
function F is continuous in the interval a < æ < b. 

Hint: If z, < x, then obviously F (æ) < F(x). Prove 
that if F(x) < F(a#,), then F(x.) = f(t) for a point t, of 
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the interval x, <t < x; conclude finally that F(a.) — 
—F (ay) < f(t) —f(%)- 

5.6. Let a continuous function f be given in an infinite 
interval «>a. Prove that the existence of the finite 
lim f(x) implies the boundedness of this function. 


5.7. Investigate which of the following functions are 
uniformly continuous: 
ae 7, x, See 
Vo jar} 

5.8. Prove that the product of two uniformly con- 
tinuous and bounded functions is uniformly continuous. 
Show by considering the example of function xsinx that 
the assumption that both functions are bounded is 
essential. 

5.9. Prove that every function f uniformly continuous 

in a finite interval a < x< b possesses the finite limits 
lim f(z) and lim f(z). 
‘ "5.10. Let F be a continuous function defined in an 
infinite interval x > a. Prove that the existence of finite 
lim f(x) implies the uniform continuity of this function. 
BAL, Prove that a function continuous in an infinite 
interval «>a and bounded neither above nor below 
assumes every real value infinitely many times. 

5.12. Give an example of a function y = f(x) defined 
in the interval 0 <a#< 1, on-to-one and continuous at 
the point x = 0 and such that the inverse function æ = g(y) 
is discontinuous at the point y, = f(0). 


Exercises on § 6 


6.1. Investigate the uniform convergence of the follow- 
ing sequences of functions: 


falz) = na(l—x)”  (0<2<1), 


fale) = y1 Fa (ew ). 
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6.2. Similarly: examine the uniform convergence of 
the following series of functions: 


fos] 0o 


6.3. Prove that the function f given by the formula 


f(x) = Yan 


n=1 


is continuous at every point at which it is defined (i.e. for 


æ # n). 
6.4. Prove that the function 


œ 
= X y rer 
n=l 


is continuous in the interval x > 0 and discontinuous at 
the point æ = 0. 

6.5. Prove that if the functions fi, fo, ...,fn,... are 
continuous and positive in a closed interval a <æ < b 


and the series > jn(z) is convergent to a continuous 


function, then the convergence is uniform. 
(Note that the uniform convergence of the series 


> fn(z) is equivalent to the uniform convergence of the 
n=1 


sequence F(a”) = J falx) to the function equal to 0. 
n=m-+1 


Assuming that the convergence is not uniform, conclude 

the existence of a convergent sequence {£m} such that 

Rm(8m) > e > 90 for infinitely many indices m. Writing 
= lim £m prove that Rp(x,) > £ for every n.) 


mao 
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6.6. Find the radius of convergence of the following 
power series: 


oO 


> [2+ (—1)"P'2", > te (where en = 0 or 1). 


n==1 


6.7. Let r be the radius of convergence of a given 
co fo 8) 
. . . a J 

power >, anx”. Prove that if r is finite and >, anr” = oo, 
n=0 n=0 


then lim J ana”= co (a complement to the Abel theo- 


x=r—0 n=0 
rem). 


Hint: Reduce the proof to the special case r = 1; note 
CO 


also that D>, Ana” = (1—2) ee where Sn = a+4,+ 


n=0 n=0 
+... 4n. 
6.8. Prove that if a, > 0, then the Abel theorem may 
be reversed. Speaking more strictly, if r denotes the radius 


co 
. i > 
of convergence of the power series X anx”, then (assuming 
n=O 


that r is finite) the existence of the finite lim J ana” = g 
e2r—0 %=0 
implies the convergence of the series È anr” (to g). 


n= 
6.9. Let 2 an and 2 ba be two convergent series. 


Prove that if the Cauchy Product of these series, i.e. the 
series > Cy With Cn = obn + aibu -1+ + nb), is con- 
n=- 0 


vergent, then 


(compare this with the Cauchy theorem of § 3.8). 
Hint: Note that Sam = Daur" So, a forO<a<1 


nu=0 


and apply the Abel “theorem. 
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6.10. Let r denote the radius of convergence of a given 


oo 
power series X ana". Prove that the infinite product 


n=0 
[](1+4,2") is convergent if |z|<r and divergent if 
=0 


n= 
æj >r. 


Exercises on § 7 


7.1. Prove that if the function f is differentiable in 
an infinite interval x >a and lim f(x)= 0, then the 


equation f'(x) = 0 has in this interval no less roots than 
the equation f(z) = 0. 

7.2. Let the function f be differentiable in an interval 
a< < b (finite or infinite). Prove that if the derivative f’ 
is bounded, then f is uniformly continuous in this interval. 

7.3. Prove that if the function f is differentiable in 


an infinite interval v >a and lim f'(x)= oo, then it is 
T= 


not uniformly continuous in this interval. 

7.4. Let f be a function differentiable in an infinite 
interval x > a. Prove that if lim f'(x) = g, then tim EE (2) 
= g, too. " 

Hint: One may apply the theorem of exercise 5, § 4. 

7.5. Prove that 

1— T 

arc tang -+ are tan —— I 7" za 

Hint: Find the derivative of the left side. 
7.6. Prove that if a > 1, then 


(a> —1). 


gi S a+ (l—a)* <1 
for 0< xr <1. 
7.7. Prove that if 0< a< 1, then 


(æ+ y) < + y" 


for any positive x and y (a generalization of the inequality 
given in exercise 1.3). 
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oo 


7.8. Prove that the series X a*e-"* is uniformly con- 
Nal 
vergent in the interval v > 0. 


Hint: Find the upper bound of the function a%e-***, 
7.9. Prove that 


oo 


PP ae 
X nt = (i_a + s’ (læ| < 1). 


n=1 
nd log(1+ æ) 


: 1 
7.10. Expand the functions TEE a iFa 


in power series. 
7.11. Prove that if f'(x) = f(z) for all a < æ < b, then 
f(z) = Cet, where C is a constant. Deduce that 


! t æ a” 
@=ltgtaytet+ at. 
for every 2. 
7.12. Prove that if 0< a< 1, then the equation 


xe, x am 
l+ ta tetas ae” 
possesses in the interval x > 0 exactly one root x = a(n). 


Show that lim x(n) = oo. 
7.13. Prove that if lim a, = g (finite), then 
n=% 


0o 
3 an 
lim e-? D an — =g 
z=% mn 


Exercises on § 8 
8.1. Let 
f(x) = asin ~ for «#0, f(0)=0. 


Investigate the existence of the second derivative f’’(x). 
8.2. Prove that if a function f possesses the second 
derivative at a point x, then 


fet hy+f(o—h)—2f(a) 


fa) = lim ia 


322 SUPPLEMENT 


8.3. Prove that if the n-th derivative f™ of a function f 
is bounded in a finite interval a < æ < b, then the function f 
is bounded, too. 

8.4. Prove that if |z|< 4, then the approximate 


formula 
Vl+2 21+ }4e— te 


gives the value of Y1+ 2 with an error less than }{2/*. 

8.5. Applying the Maclaurin formula to the function e” 
evaluate the first four figures of the decimal expansion 
of the number e. 

8.6. Expand the functions ar sinha and sin‘z in power 
series. 

8.7. Deduce the formula 


S11 13-5... (2n—3) 
2n 2-4... (2n) 


n=2 


læ] = 1—4 (1—2?) — (1— a2)" 


for —i <z <1. 
8.8. Let f be a function continuous in an interval 
a <x <b. Prove that if its second derivative exists inside 
this interval and f(x) >0 everywhere, then 
f(aa-+ Bb) < af(a)+ Af(d) 
for any positive numbers a and # satisfying the condition 
a+ ß = 1. Likewise, if f”(x)< 0, then 
f(aa+ Bb) > af(a)+ Bf(d) . 
Give a geometrical interpretation of these inequalities. 
Hint: Investigate the sign of the auxiliary function 


f(b) — f(a) 


g(x) = f(x) — f(a)— pogo ea): 
1 1 
8.9. Let p>0, qg>9, 7 Pa = 1. Prove that 
sys 


for x > 0, y > 0. 
Hint: Substitute in the previous exercise: f(x) = logz. 
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Exercises on § 9 


9.1. Give an example of a function defined in an in- 
terval a < x < b, which do not possess a primitive func- 
tion in this interval. 

9.2. Prove the existence of a primitive function of the 
function 


fw) = sin} fore 40, f(0)=0. 
9.3. Find the integral 
J (jal + e+ hide. 
9.4. Deduce the recurrence formulas 


dx — COST , n—2 dx 
sin”æ  (n—J)sin™ tæ  n—i J sin™ 2x 


and 


Í d sinr n—2 dir 
cos”x (n—l)cos""'x  n—1lJ cos**x 
(n is an integer > 2). 
9.5. Find the integrals 
dx dx 
Pree and costa 
9.6. Applying the recurrence method calculate the in- 


tegrals 
dx 
errata wee ‘ on ap 
Pees and J tog ada, 
where n is a positive integer. 


Exercises on § 10 


10.1. Applying the formula 


sy2 


2 12 9 
f Z dx = 10 BOVIS eta kG 
1+ a4 y2 ~at+aj/241 1 —2? 
we obtain 
v2 ye 1 
f dz = — ——log5 —2arc tan2 < 0. 
J lat 4y2 
0 
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This result is false, since the function under the sign of 
the integral is positive. Explain the reason for this error 
and find the actual value of the above integral. 

10.2. Prove that if the function f is continuous and 
positive in the interval a < æ < b, then denoting by M its 
upper bound the following formula holds: 


nj b 
lim) f [f(#)!"de = M 


10.3. Let f be a function defined and continuous for 
all values æ. Find the derivative of the function g defined 
by the formula 


b 
g(x) = ff(wttydt. 
a 
10.4. Find the limit 
1™4 3" + + (20 —1)" 


nm pn+l 
2k—i 1/k—i k 
fein: 2n =5( oe a): 


10.5. Evaluate 


lim > (n+1)(n+2)... (nF n). 


10.6. Prove that if the function f possesses a continu- 
ous derivative in the interval 0 < x < 1, then 


imni 2) - frea] Lg 


Apply this formula to evaluate the limit 
eee o1 ) 


lim n 


n=-09 ninth m+1 : 


0.7. Evaluate the limits 


sin” g 


lim | Vasingds lim f z. 
n=0 x v: ‘ 1h-=00 & Vl+a 
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10.8. Prove that if the function f has a continuous 
(n+1)-th derivative in the interval a < æ < b, then 


n b 
(k) 
(0) = fat SF oat 5 f forrn(ay(b—ayrae. 
k=1 0 


(another form of the Taylor formula). 
Hint: Proof by mathematical induction. 


Exercises on § 11 


11.1. Prove the convergence of the integrals 


cosia a. loge 4, f cos ya a 
E yarirn — g) , z i+ ' x 


dx is non-abso- 


sinx 


11.2. Show that the integral f = 
0 


lutely convergent (and thus is an example of a condition- 
ally convergent integral). 
Hint: |sinz| > sin?x. 


+00 


11.3. Prove that if the integral f f(x)dx is absolutely 


convergent, then 


+00 +00 
lim f f(x) cosnede = 0 = lim f f(w)sinnxdx 


(ef. § 10.2, Example (8)). 

11.4. Prove that if the integral ETT is con- 
vergent and the function g is monotone, bounded and 
possesses the first derivative continuous in the interval 
x >a, then the integral Troad is convergent, too. 


Hint: Apply the Cauchy theorem (§ 11.1, 2), taking 
into account the second mean-value theorem (§ 10.7) 
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11.5. Prove that 


lia = atn 
11.7. Prove that 
oo 0o 
xe? 
f [oer Ze 
n=1 
d Z M 
Hint: Apply the formula oS ba ; 


n=l 
‘11.8. Let the function f be continuous and monotone 
in the interval x > a. Prove that the convergence of the 


co 
integral f af(«)dx implies lim a+1f(x) = 0. 
a g= 


i 
Hint: Consider the integral f t*f(t)dt. 


£ 
11.9. Assuming that f is a function continuous and 
monotone in the interval 0 < x < 1 and that the interval 


1 
f f(x)dx is convergent, prove the formula 
0 


3 1 
lim ZIN) = J fle)de . 


11.10. Let the function f be continuous, decreasing 
and positive in the interval x > 0. Prove that if the in- 


tegral f f(x)dx is convergent, then the following formula 
0 
holds: 


lim t Ò f(tn) = J f(x) da. 


n=) 
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In particular, find the limit 


o0 
lim > i 
lago ome 1+ nit" 


Hint: Compare the proof of the Cauchy-Maclaurin 
theorem (§ 11.6). 
11.11. Prove that if f is a function continuous in the 
interval x > 0 and lim f(x) = g (finite), then 
L=00 


oO 


lim t f e~"f(a)de =g. 
t=40 9 
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